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CHAPTER 


APPROXIMATIONS AND ERRORS 
IN COMPUTATION 


Chapter Objectives 

e Introduction 

e Accuracy of numbers 

e Errors 

e Useful rules for estimating errors 

e Error propagation 

e Error in the approximation of a function 
e Error ina series approximation 

e Order of approximation 

e Growth of error 


e Objective type of questions 


1.1. Introduction 


The limitations of analytical methods in practical applications have led 
scientists and engineers to evolve numerical methods. We know that exact 
methods often fail in drawing plausible inferences from a given set of tabulat- 
ed data or in finding roots of transcendental equations or in solving non-linear 
differential equations. There are many more such situations where analytical 
methods are unable to produce desirable results. Even if analytical solutions 
are available, these are not amenable to direct numerical interpretation. 
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The aim of numerical analysis is therefore, to provide constructive methods 
for obtaining answers to such problems in a numerical form. 


With the advent of high speed computers and increasing demand for 
numerical solution to various problems, numerical techniques have become 
indispensible tools in the hands of engineers and scientists. 


The input information is rarely exact since it comes from some mea- 
surement or the other and the method also introduces further error. As 
such, the error in the final result may be due to an error in the initial data 
or in the method or both. Our effort will be to minimize these errors, so as 
to get the best possible results. We therefore begin by explaining various 
kinds of approximations and errors which may occur in a problem and de- 
rive some results on error propagation in numerical calculations. 


1.2 Accuracy of Numbers 


1. Approximate numbers. There are two types of numbers: exact and ap- 
proximate. Exact numbers are 2, 4, 9, 13, 7/2, 6.45,... etc. But there 
are numbers such as 4/3 ( = 1.33333...), J (= 1.414213...) and (= 


3.141592...) which cannot be expressed by a finite number of digits. 
These may be approximated by numbers 1.3333, 1.4142 and 3.1416, re- 
spectively. Such numbers which represent the given numbers to a cer- 
tain degree of accuracy are called approximate numbers. 


2. Significant figures. The digits used to express a number are called signif- 
icant digits (figures). Thus each of the numbers 7845, 3.589, and 0.4758 
contains four significant figures while the numbers 0.00386, 0.000587, 
and 0.0000296 contain only three significant figures since zeros only 
help to fix the position of the decimal point. Similarly the numbers 
45000 and 7300.00 have two significant figures only. 


3. Rounding off. There are numbers with large number of digits, e.g., 
22/7 = 3.142857143. In practice, it is desirable to limit such numbers 
to a manageable number of digits such as 3.14 or 3.143. This process of 
dropping unwanted digits is called rounding off. 


4. Rule to round off a number to n significant figures: 
(i) Discard all digits to the right of the nth digit. 
(ii) If this discarded number is 
(a) less than half a unit in the nth place, leave the nth digit un- 
changed; 
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(b) greater than half a unit in the nth place, increase the nth digit 
by unity; 

(c) exactly half a unit in the nth place, increase the nth digit by unity if it 
is odd other wise leave it unchanged. 


For instance, the following numbers rounded off to three significant 
figures are: 


7.893 to 7.89 3.567 to 3.57 
12.865 to 12.9 84767 to 84800 
6.4356 to 6.44 5.8254 to 5.82 


Also the numbers 6.284359, 9.864651, and 12.464762 are rounded off 
to four places of decimal at 6.2844, 9.8646, 12.4648; respectively. 


Obs. The numbers thus rounded off to n significant figures (or 
NOTE =n decimal places) are said to be correct to n significant figures 
(or n decimal places). 


1.3. Errors 


In any numerical computation, we come across the following types of 
errors: 


1. Inherent errors. Errors which are already present in the statement of a 
problem before its solution, are called inherent errors. Such errors arise 
either due to the given data being approximate or due to the limitations 
of mathematical tables, calculators, or the digital computer. Inherent er- 
rors can be minimized by taking better data or by using high precision 
computing aids. 

2. Rounding errors arise from the process of rounding off the numbers 
during the computation. Such errors are unavoidable in most of the cal- 
culations due to the limitations of the computing aids. Rounding errors 
can, however, be reduced: 

(i) by changing the calculation procedure so as to avoid subtraction of nearly 
equal numbers or division by a small number; or 

(ii) by retaining at least one more significant figure at each step than that given 
in the data and rounding off at the last step. 


4 © Numerical METHODS IN ENGINEERING AND SCIENCE 


3. Truncation errors are caused by using approximate results or on replacing an 
infinite process by a finite one. If we are using a decimal computer having a 
fixed word length of four digits, rounding off 13.658 gives 13.66 whereas trun- 
cation gives 13.65. 


2 2p x! 
ae? 
For example, if e* Sitesi tat gt 00 = X (say) 
8 
is replaced by l+xto aI =X’ (say), then the truncation error is 


X-X’. 
Truncation error is a type of algorithm error. 
4. Absolute, Relative, and Percentage errors. If X is the true value of a 


quantity and X’ is its approximate value, then |X — X’ | i.e, is called 
the absolute error Ea.. 


Error 


The relative error is defined by E, = ie. 


aS . 


2 
True value 


X—X' 


and the percentage error is E,, = 100E, = 109 


If X be such a number that |X — X'|< X, then X is an upper limit on 
the magnitude of absolute error and measures the absolute accuracy. 


Obs. 1. The relative and percentage errors are independent of 
NOTE | the units used while absolute error is expressed in terms of these 
units. 
Obs. 2. If a number is correct to n decimal places then the error 
1 —n 
= 510". For example, ifthe number is 3.1416 correct to 4 deci- 


4 


i eee 
mal places, then the error = 310 * = 0.00005. 


1.4 Useful Rules for Estimating Errors 


To estimate the errors which creep in when the numbers in a calcula- 
tion are truncated or rounded off to a certain number of digits, the follow- 
ing rules are useful. 


If the approximate value of a number X having n decimal digits is X’, 
then 


NOTE 
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1. Absolute error due to truncation to k digits 
=|X-X|< 10" 
2. Absolute error due to rounding off to k digits 
=|X-X'l< stor 


3. Relative error due to truncation to k digits 


X 
4. Relative error due to rounding off to k digits 
= 1 
= aan <—0'* 
X 2 
Obs. 1. If a number is correct to n significant digits, then the 


Baca 
maximum relative error = Pia - Ifa number is correct to d 


1 —d 
decimal places, then the absolute error = 919 : 


Obs. 2. [f the first significant figure of a number is k and the 
number is correct to n significant figures, then the relative error 
<1/ 

(kx 10°), 


Let us verify this result by finding the relative error in the number 
864.32 correct to five significant figures. 


Here k=8,n=5 and 
1 
Absolute error + 0.01 x 37 0.005. 


.. Relative error 


0.00 5 — 1. 1 
~ 864.32 864320 2x86432  2x80000 
1 — 1 


— < 1.6, =a 
2x8x104 8x10! kx10"? 


Hence the result is verified. 
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EXAMPLE 1.1 


Round off the numbers 865250 and 37.46235 to four significant figures 
and compute E_, E, E, in each case. 


Solution: 


(i) Number rounded off to four significant figures = 865200 
E, =|X-X, | =| 865250 — 865200 | = 50 


X—X,|_ 0.00235 
X | 37.46235 
EP = E. x 100 = 6.71 x 10°? 

(ii) Number rounded off to four significant figures = 37.46 


B= | =Go7 x10” 


. E,=|X-X, | =| 3746235 — 37.46000 | = 0.00235 


X 37.46235 


E, = E x 100 = 6.27x 10~ 


7 


EXAMPLE 1.2 
Find the absolute error if the number X = 0.00545828 is 


(i) truncated to three decimal digits. 
(ii) rounded off to three decimal digits. 


Solution: We have X = 0.00545828 = 0.545828 x 10°? 


(i) After truncating to three decimal places, its approximate value 
X’ = 0.545 x 107 
. Absolute error = |X — X’ | = 0.000828 x 10° 


= 0.828 x 10-5 < 10? 
This proves rule (1). 


(ii) After rounding off to three decimal places, its approximate value 


X’ = 0.546 x 10° 
. Absolute error = |X — X’| 


= | 0.545828 — 0.546 | x 102 


= 0.000172 x 10° = 0.172 x 10° 
which is < 0.5 x 10°. This proves rule (2). 
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EXAMPLE 1.3 
Find the relative error if the number X = 0.004997 is 


(i) truncated to three decimal digits 
(ii) rounded off to three decimal digits. 


Solution: We have X = 0.004997 = 0.4997 x 10°? 


(i) After truncating to three decimal places, its approximate value 
X = 0.499 x 10°: 


“. Relative error = 


—X'|_ seer x 107? - 0.499 x 10 
0.4997 x 10° 


= 0.140 x 10° < 10*° 


This proves rule (3). 


(ii) After rounding off to three decimal places, the approximate value of the 


given number 


X’ = 0.500 x 10-7 


.. Relative error = 


0.4997 x 10° 
= (1.600 x 10°? = 0.06 x 1073*# 


which is less than 0.5 x 10°**. This proves rule (4). 


Eo > seer x 107? — 0.500 x 107 


Exercises 1.1 


1. Round off the following numbers correct to four significant figures: 
3.26425, 35.46735, 4985561, 0.70035, 0.00032217, and 18.265101. 


2. Round off the number 75462 to four significant digits and then calculate 
the absolute error and percentage error. 


3. If 0.333 is the approximate value of 1/3, find the absolute and relative 
errors. 


4. Find the percentage error if 625.483 is approximated to three significant 
figures. 


5. Find the relative error in taking n = 3.141593 as 22/7. 


6. The height of an observation tower was estimated to be 47 m, whereas 
its actual height was 45 m. Calculate the percentage relative error in the 
measurement. 
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7. Suppose that you have a task of measuring the lengths of a bridge and a 
rivet, and come up with 9999 and 9 cm, respectively. If the true values 
are 10,000 and 10 cm, respectively, compute the percentage relative 


error in each case. 
2 3 
xXx 
8. Find the value of ex using series expansion eX =1+x+—+—4... for 


x = 0.5 with an absolute error less than 0.005. 2! 3! 


9. 29 =5.385 and Jz =3.317 correct to 4 significant figures. Find the 
relative errors in their sum and difference. 


10. Given: a = 9.00 + 0.05, b = 0.0356 + 0.0002, c = 15300 + 100, d = 62000 
+500. Find the maximum value of absolute error ina+b+c+d. 


11. Two numbers are 3.5 and 47.279 both of which are correct to the signifi- 
cant figures given. Find their product. 


12. Find the absolute error and the relative error in the product of 432.8 
and 0.12584 using four digit mantissa. 


13. The discharge Q over a notch for head H is calculated by the formula 
Q =kH?°” where k is a given constant. If the head is 75 cm and an error 
of 0.15 cm is possible in its measurement, estimate the percentage error 
in computing the discharge. 


14. If the number p is correct to 3 significant digits, what will be the maxi- 
mum relative error? 


1.5 Error Propagation 


A number of computational steps are carried out for the solution of a 
problem. It is necessary to understand the way the error propagates with 
progressive computation. 


If the approximate values of two numbers X and Y be X’ and Y, respec- 
tively, then the absolute error 


E,,=X-X andE, =Y-Y’ 


1. Absolute error in addition operation 
X+Y=(X+E )+(V'+E, ) 


ay 
=H=X’+Y'+E +E 
ax ay 
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“(X+Y)-QW+Y)|S|E_+E£, |S\|E_|+|£_| 


ax ay ax ay 


Thus the absolute error in taking (X’ + Y’) as an approximation to (X + Y) 
is less than or equal to the sum of the absolute errors in taking X’ as an 
approximation to X and Y’ as an approximation to Y. 


. Absolute error in subtraction operation 


X-Y=(X +E )-(Y'+E,) 


ay 


=(X’-Y')+(E,.- E,) 


ax ay 

=a) Y)| = Eg ~ Ey) <lE nl +1 E,,| 
Thus the i. error in taking (X’ — Y’) as an approximation to (X — Y) 
is less than or equal to the sum of the absolute errors in taking X’ as an 


approximation to X and Y’ as an approximation to Y. 


. Absolute error in multiplication operation 


To find the absolute error E, in the product of two numbers X and Y, we 
write 
=(X+ E_) (Y+E,,) — XY 
where E_ and E, ay are - absolute errors in X and Y, respectively. Then 
E, XE,, + YE,, + E,E, 


Assuming E and E_ are reasonably small Ne) that E, E, _can be ignored. 
Thus E, =XE, Pas YE, |. approximately. 


. Aicalene error in Pee operation 


Similarly the absolute error E, in the quotient of two numbers X and Y 
is given b 

8 y _X+E, X_ VE = AE, 

Yth, Y V(Y+E,) 


YE, — XE 


ax ay 
~¥ a +E yl Y) 
Fax = XE, 


= = assuming Egy to be small. 


E 


EXAMPLE 1.4 


Find the absolute error and relative error in 6 +J/7 +8 correct to 
4 significant digits. 
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Solution: 

We have V6 = 2.449,/7 = 2.646, /8 = 2.828 
S= 6+ V7 + J8 =7.923. 

Then the absolute error E,_ in S, is 


E_ = 0.0005 + 0.0007 + 0.0004 = 0.0016 


This shows that S is correct to 3 significant digits only. Therefore, we 
take S = 7.92 Then the relative error E_ is 


EXAMPLE 1.5 


The area of cross-section of a rod is desired up to 0.2% error. How ac- 
curately should the diameter be measured? 


Solution: 


2 
D It 
IfAistheareaand Disthe diameteroftherod,then A = 2 (>) = qP x D. 


Now error in area A is 0.2%, i.e., 0.002 which is due to the error in the 
product D x D. 


We know that if E, is the absolute error in the product of two numbers 
X and Y, then 


on = Ae + YE ¢ 
Here, X= Y=DandE .=E ,=E,, therefore 
E,=DE,+DE,, or 0.002=2DE, 


Thus, E,=0.001/D, i.e., the error in the diameter should not exceed 
0.001 D*. 


EXAMPLE 1.6 


Find the product of the numbers 3.7 and 52.378 both of which are cor- 
rect to given significant digits. 


Solution: 


Since the absolute error is greatest in 3.7, therefore we round off the 
other number to 3 significant figures, i.e., 52.4. 
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*. Their product P = 3.7 x 52.4 = 193.88 = 1.9388 x 10°. 


Since the first number contains only two significant figures, therefore 
retaining only two significant figures in the product, we get 


P=1.9~x 10°. 


1.6 Error in the Approximation of a Function 


Let y = f(x,, x,) be a function of two variables x,, x,. If 6x,, dx, be the 


COS IS, Ky ie the error dy iny is given by 


y + Oy = f(x, + Ox,,x, + dx,) 
Expanding the right hand side by Taylor’s series, we get 
y+ oy = f(x1,x2)+ [eas af +x) 


+ terms involving higher powers of dx, and dx, (i) 


If the errors dx,, Ox, are so small that their squares and higher powers 
can be neglected, then (i) gives 


0 0 
Oy = ct eo + ow, approximately. 


Hence, Ope 25, +B 


In general, i error Oy in the function y =f(x,, x,, ... x,) corresponding 


to the errors dx, in , (i = 1, 2, ... n) is given by 
0 On 
py ee he Hi, 
Ox) OX Ox, 


Oy dy Ox, 2 dy OX, Se dy OX 
Oxy Y OXg Yy OX, y 


and the relative error iny is E,, = 


EXAMPLE 1.7 
If w = 4x*y*/z* and errors in x, y, x are 0.001, compute the relative 
maximum error in u when x = y=sz=l. 
Solution: 
du _ Sxy" ou _ 12x*y? au 16x"y* 


ax Cay a 


Since — 
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12x*y? 
af 


u 


8xy? 16x?y? 
6a=— ox + “Fb. 
z z 


5 


“ Ou= a i 2 oy + : oy — 
Ox oy 0 


Since the errors dx, dy, 0% may be positive or negative, we take the ab- 
solute values of the terms on the right side, giving 


Sxy? 12x7y” 16x7y° 
6x4 |— by =| 


es) 


A 


(OW) max 
= 8(0.001) + 12(0.001) + 16(0.001) = 0.036 
Hence the maximum relative error = (du), /u=0.036/4 = 0.009. 
EXAMPLE 1.8 
Find the relative error in the function y = ax,""xq"" +++x 
Solution: 


We have logy = log a + m, log x, + m, log x, +... +m, log x, 


1 oO 1a 
_ Lay om 1 ay ms a 
yox, X YOOX, — Xy 


dy Ox, ae dy Ox See 


Hence FE. = 
OX} Yy OX» Yy OX, Y 
Ox, OX, Ox, 
=m,—+m,— +---+m, — 
xy Xo Xn 


Since the errors dx,, Ox,,..., 0x, may be positive or negative, we take the 
absolute values of the terms on the right side. This gives: 


Ox Ox: Ox 
(Fee. <m,|—|+m,|—|+...+m, 
: xy Xg Xn 
Cor. Taking a = 1, m, =m, =...=m, = 1, we have 
Yy = XiX5 Xv, 

Ox, Ox; Ox 
then Be 
X, Xe X, 


Thus the relative error of a product of n numbers is approximately equal 
to the algebraic sum of their relative errors. 
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1.7 Error in a Series Approximation 


We know that the Taylor’s series for f(x) at x = a with a remainder after 


n terms is Gaia 
fix) = fla+x—a)= fla)+(x-a) {Or fla) 
i f’1@+R, (x) 
c “ (n-1)! — 
where R,,(x) = as (0),a<O<x. 
nN. 


If the series is convergent, R (x) > 0 as n — © and hence if f(x) is ap- 
proximated by the first n terms of this series, then the maximum error will 
be given by the remainder term R (x). On the other hand, if the accuracy 
required in a series approximation is preassigned, then we can find n, the 
number of terms which would yield the desired accuracy. 


EXAMPLE 1.9 


Find the number of terms of the exponential series such that their sum 
gives the value of e* correct to six decimal places at x = 1. 
2 3 n-1 


. o je tae , : . 
Solution: We have e ay tate tomy tT Rn) (i) 


wn 


where R,,(x) = = 69.0 <O0<x. 
n 


ae ; 
“. Maximum absolute error (at@ =x) = —e and the maximum relative 
n 
nN: 
error —*_ . 


n! 
Hence (E_) atx = Lis eo 
ax ; | . 
n: 
For a six decimal accuracy at x = 1, we have 


— <510", ie.,n! > 2x 10° which gives n = 10. 
nt 

Thus we need 10 terms of the series (i) in order that its sum is correct 
to six decimal places. 
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EXAMPLE 1.10 
The function f(x) = tan x can be expanded as 


x? x? ‘i yond 
=| ? ¥ A= 
tan” x =x—-—+—-—---+(-])" ——+--., 
3 5 2Qn-1 
Find n such that the series determine tan™ x correct to eight significant 
digits atx = 1. 
Solution: 


If we retain n terms in the expansion of tan x then (n + 1)th term 


xentl 
=(-])"- 
2Qn+1 
(—])" 
2Qn+1 forx = 1 
To determine tan™ (1) correct to eight significant digits accuracy 
-1)"| 1 
CD <—x10° ie., 2n + 1 > 2x 108 or pipet 
Qn+1]] 2 


Hence n = 10° + 1. 


1.8 Order of Approximation 


We often replace a function f(h) with its approximation @(h) and the 
error bound is known to be “(h"), n being a positive integer so that 
[fih) h) | <u|h"| for sufficiently small h. 


Then we say = a approximates f(h) with order of approximation 
O(h") and write f(h) = p(h) + O(h"). 


1 ‘ 
For instance, pai th th’ +h +h! +h? + 


is written as : 


—=1+h+h? +h? +0(h*) (i) 


to the 4th order of approximation. 

h2 h* ns h’ 
+———_+—- 

2! 4! 6! 8! 

to the 6th order of approximation becomes 


Similarly cos(h) =1— 
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h? ht 


cos(h) = i-7 + tO) (ii) 
The sum of (i) and (ii) gives 
h? h* 
Gh)! +cos(h)=2+h eT +h? +0(h') + olh®) (iii) 


4 
Since O(h*) + “ = O(h*) and O(h*) + O(h®) = O(h*) 
i 2 
-. (iti) takes the form (1—h)' + cos(h)=2+h+ ‘ +h? +0(h*), which 
is of the 4th order of approximation. 


Similarly the product of (i) and (ii) yields 
(1—h)  cos(h)=(+h+h? +h? yf ener +h® )o(h®) 


-E ot " Joln') +0000") 


2 3 4 6 7 
Sjaje a oe en” 26) 20) 00,00) (iv) 
2°92 % 94 '% A 


Since O(h*) O(h® =O¢h"’) 
4 6 7 

et eee ln) 40h) +0(n) <0ln') 
QA 94 QA 


and — 


2 3 
. (iv) is reduced to —h)! cos(h)=1+h+ - + “ +0O(h*), which is of 
the 4th order of approximation. 


1.9 Growth of Error 


Let e(n) represent the growth of error after n steps of a computation 
process. 


If \e(n) | ~ n €, we say that the growth of error is linear. 
If |e(n) | ~ 6" € we say that the growth of error is exponential. 
If 6 > 1, the exponential error grows indefinitely as n > 00, and 


if 0 < 6 < 1, the exponential error decreases to zero as n > ©. 
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Exercises 1.2 


10. 


11. 


. Find the value of I= f 


. Find the smaller root of the equation x«* — 400x + 1 = 0, correct to four 


decimal places. 


. Ifr =h(4h* —5), find the percentage error in r at h = 1, if the error inh 


is 0.04. 


. If R= 10x°y’z’ and errors in x, y, z are 0.03, 0.01 and 0.02, respectively 


atx =3, y = 1,% = 2. Calculate the absolute error and % relative error in 
evaluating R. 


. If R = 4xy?/z? and errors in x, y, x are 0.001, show that the maximum 


relative error at x = y =z = 1 is 0.006. 


2 
If V= un + | and the error in V is at the most 0.4%, find the per- 


2 


centage error allowable in r and h when r=5.1 cm and h =5.8 cm. 
0.8 sinx 


dx correct to four decimal places. 
Bi 


3 5 
x x 


. Using the series sinx =x—->-+——-++, evaluate sin 25° with an ac- 


3! O8! 
curacy of 0.001. 


. Determine the number of terms required in the series for log (1 + x) to 


evaluate log 1.2 correct to six decimal places. 


; 1+x x x? 
. Use the series log, | ——]=2| x + = + SB +--+} to compute the value of 


l-x 
log (1.2) correct to seven decimal places and find the number of terms 
retained. 


Find the order of approximation for the sum and product of the follow- 
ing expansions: 


° kW i hee 6 
et =1+h+—+—+0(h*) and cos(h) =1-—-+—+Olh i: 
2 3 Q! A! 


Given the expansions: 
Pp £ ; ae 
sin(t)=t -—+—+0(¢7) and cos(t)=1-—+—+0(¢°) 
3! OO! 2! 4) 


Determine the order of approximation for their sum and product. 
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1.10 Objective Type of Questions 


Exercises 1.3 


Select the correct answer or fill up the blanks in the following questions: 


. Ifx is the true value of a quantity and x1 is its approximate value, then the 


relative error is 


(a) |x, -x|A, (b) |x — x, | (c) |x ,/x| (d) x/|x, —2|. 


. The relative error in the number 834.12 correct to five significant fig- 


ures is ... 


. Ifa number is rounded to k decimal places, then the absolute error is 


ee b i. =k L k d 1 -k 
(a) 510 (b) 510 (c) 310 (d) 710 


If z is taken = 3.14 in place of 3.14156, then the relative error is 


5. Given x = 1.2, y = 25.6, and z= 4.5, then the relative error in evaluating 


11. 
12. 


w=x? +y/xis... 


. Round off values of 43.38256, 0.0326457, and 0.2537623 to four signifi- 


cant digits: ... 


. Round relative maximum error in 3x2y/z when dx = dy = dz = 0.001 at 


x=y=s=l.... 


. If both the digits of the number 8.6 are correct, then the relative error 


is... 


. Ifa number is correct to n significant digits, then the relative error is 


Ls ae 
1 =10" 1 1 
(a) 5 10" (b) 2 (c) <5l0" (d) < 510" e 


. If (J3 +V5 +7) is rounded to four significant digits, then the absolute 


error is 
(./102 - J101) correct to three significant figures is... 


Approximate values of 1/3 are given as 0.3, 0.3, and 0.34. Out of these 
the best approximation is ... 
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13. The relative error if 2/3 is approximated to 0.667, is... 


14. If the first significant digit of a number is p and the number is correct to 
n significant digits, then the relative error is ... 


CHAPTER 


SOLUTION OF ALGEBRAIC AND 
TRANSCENDENTAL EQUATIONS 


Chapter Objectives 


Introduction 

Basic properties of equations 

Transformation of equations 

Synthetic division; to diminish the roots of an equation by h 
Iterative methods 

Graphical solution of equations 

Convergence 

Bisection method 

Method of false position 

Secant method 

Iteration method; Aitken’s A2 method. 
Newton-Raphson method 

Some deductions from Newton-Raphson formula 
Muller’s method 


Roots of polynomial equations; approximate solution of polyno- 
mial equations-Horner’s method 


Multiple roots 
Complex roots 
Lin-Bairstow’s method 


Graeffe’s root squaring method 
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e Comparison of Iterative methods 


e Objective type of questions 


2.1 


Introduction 


An expression of the form f(x) =a,«"°+4,x"-'+---+a—,xt+a, 


where a’s are constants (a, # 0) and n is a positive integer, is called a polyno- 
mial in x of degree n. The polynomial f(x) = 0 is called an algebraic equation 
of degree n. If f(x) contains some other functions such as trigonometric, log- 
arithmic, exponential etc., then f(x) = 0 is called a transcendental equation. 


Def. The value a of x which satisfies fix) = 0 (1) 


is called a root of f(x) = 0. Geometrically, a root of (1) is that value of x 
where the graph of y = f(x) crosses the x-axis. 


The process of finding the roots of an equation is known as the solution 
of that equation. This is a problem of basic importance in applied math- 
ematics. 


If f(x) is a quadratic, cubic, or a biquadratic expression, algebraic solu- 
tions of equations are available. But the need often arises to solve higher 
degree or transcendental equations for which no direct methods exist. Such 
equations can best be solved by approximate methods. In this chapter, we 
shall discuss some numerical methods for the solution of algebraic and tran- 
scendental equations. 


2.2 Basic Properties of Equations 


NOTE 


I. If f(x) is exactly divisible by x — a, then a is a root of fix) = 0. 
II. Every equation of the nth degree has only n roots (real or imaginary). 
Conversely if @,, @,, ..., @, are the roots of the nth degree equation 


f(x) =0, then 
POR ARHE OH GC) 40\|\ =e) 


n 


where A is a constant. 


Obs. If a polynomial of degree n vanishes for more than n 
values of x, it must be identically zero. 
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EXAMPLE 2.1 
Solve the equation 2x° + x? — 13x + 6 = 0. 


Solution: By inspection, we find x = 2 satisfies the given equation. 


O 
FIGURE 2.1 
“. 2is its root, ie., x — 2 is a factor of 2x3 + x? — 13x + 6. 
Dividing this polynomial by x — 2, we get the quotient 2x? + 5x — 3 
and remainder 0. 
Equating this quotient to zero, we get 2x? + 5x — 3 = 0. 
Solving this quadratic, we get 
2 
= + — = 
_2S2vi5"= 42.03) ayy 
2.2 

Hence the roots of the given equation are 2, — 3, 1/2. 

III. Intermediate value property. If f(x) is continuous in the interval [a, b] 

and f(a), f(b) have different signs, then the equation f(x) = 0 has at least 
one root between x = a and x = b. 

Since f(x) is continuous between a and b, so while x changes from a to b, 
f(x) must pass through all the values from f(a) to f(b) [Figure 2.1]. But 
one of these quantities f(a) or f(b) is positive and the other negative, it 
follows that at least for one value of x (say a) lying between a and b, f(x) 
must be zero. Then @ is the required root. 

IV. In an equation with real coefficients, imaginary roots occur in conjugate 
pairs, i.e., if a + iB is a root of the equation f(x) = 0, then a — if must 
also be its root. 

Similarly if a + Vb is an irrational root of an equation, then a — Vb 
must also be its root. 
NOTE Obs. Every equation of the odd degree has at least one real 


root. 
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This follows from the fact that imaginary roots occur in conju- 
gate pairs. 


EXAMPLE 2.2 
Solve the equation 3x° — 4x° + x + 88 = 0, one root being 2 + V7i. 
Sol. Since one root is 2+ Vii, the other root must be 2— VTi : 
“. The factors corresponding to these roots are (x-2- V7i) and 
(x-2+-V7i) 
or (x-2-V7i)(x-24+V7i) =(x-2) +7 =x" -4x411 
is a divisor of 3x3 — 4x2 +x + 88 (i) 
.. Division of (i) by x? — 4x + 11 gives 3x + 8 as the quotient. 
Thus the depressed equation is 3x + 8 = 0. Its root is — 8/3. 
Hence the roots of the given equation are 2+ V7i - 8/3 | 


V. Descarte’s rule of signs. The equation f(x) = 0 cannot have more posi- 
tive roots than the changes of signs in f(x); and more negative roots than the 


changes of signs in f(-). 
For instance, consider the equation f(x) = 2x7 - x° + 4x° - 5 =0 (i) 


Signs of f(x) are + - + - 


Clearly f(x) has 3 changes of signs (from + to - or - to +). 
Thus (i) cannot have more than 3 positive roots. 


Also fl-x) =2(-f)" (- x)? +4(— x)? - 5 
== 97" 429-49 -5 


Ws 


This shows that f(x) has 2 changes of signs. 


Thus (i) cannot have more than 2 negative roots. 


Obs. Existence of imaginary roots. If an equation of the nth de- 
gree has at the most p positive roots and at the most q negative 
roots, then it follows that the equation has at least n 

— (p + q) imaginary roots. 


NOTE 


SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQUATIONS © 23 


Evidently (i) above is an equation of the 7th degree and has at 
the most 3 positive roots and 2 negative roots. Thus (i) has at 
least 2 imaginary roots. 


VI. Relations between roots and coefficients. If a,, @, a, +++, a, are the 
roots of the equation 


F -1 nd ‘ = 
Ge tae tag" +040 .x+4a,=0 (1) 


t 
a 
then ) a,=-s+ 
XQ 


a3 
> aa,a5 = 7 
a) 

a 

= nn 

,AA3°+-a, =(—1)" + 

dy 


EXAMPLE 2.3 


Solve the equation x° — 7x? + 36 = 0, given that one root is double of 
another. 


Solution: 
Let the roots be a@, f, y such that 6 = 2a. 
Also atP+y=7,aB + By +ya=0, apy = - 36 


8a+y=7 (i) 
2a? + 3ay =0 (ii) 
2aty = - 36 (iii) 


Solving (i) and (ii), we get a = 2, y = - 2. 
[The values a = 0, y = 7 are inadmissible, as they do not satisfy (iii) ]. 


Hence the roots are 3, 6 and - 2. 


EXAMPLE 2.4 


Solve the equation x* - 2x° + 4x? + 6x - 21 =0, given that the sum of two 
its roots is zero. 
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Solution: 
Let the roots be a, f, y, 6 such that a + 6 =0. 
Also at+Pt+y+d0=2 
y+d=2 
Thus the quadratic factor corresponding to @, is of the form x? — Ox +p 
and that corresponding to y, 6 is of the form of x? - 2x + q. 
at — 2x3 + 4x? + 6x — 21 = (x? + p)(x? - 2x + q) (i) 
Equating coefficients of x* and x from both sides of (i), we get 
4=p+q 6=—- 2p 
p= -3, q=7. 
Hence the given equation is equivalent to 
(x? — 3)(x? — 2x + 7) =0 
. The roots arex = + V3, 1+iv6. 


EXAMPLE 2.5 


Find the condition that the cubic x° — x? + mx — n = 0 should have its 
roots in 
(a) Arithmetical progression — (b) Geometrical progression. 
Solution: 
(a) Let the roots be a - d, a, a +d so that the sum of the roots = 3a =li.e., 
a=1/3. 
Since a is the root of the given equation a° - la? + ma -n=0 
Substituting a = 1/3, we get 2/° - 91m + 27n = 0 which is the required 
condition. 
(b) Let the roots be a/r, a, ar, then the product of the roots = a? =n. 
Since a is a root of the given equation 
a —la?+ma-n=0 
Putting a = (n)'", we get n — In + mn'8 —n =0 orm=ln® 
Cubing both sides, we get m? = In 


which is the required condition. 
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EXAMPLE 2.6 


If a, B, y are the roots of the equation x* + px + q = 0, find the value of 
(a) Xa’p, (b) Eat. 


Solution: 
We have at+Bpt+y=0 (i) 
ap + py +ya=p (ii) 
apy =—q (iii) 


(a) Multiplying (i) and (ii), we get 
ebB+aryt Byt PatyatyB + 3aBy =0 

or Xap = — 3aBy = 3q [by (iii) ] 

(b) Multiplying the given equation by x, we get 

x* + px? + qx =0 
Putting x = @, , y successively and adding, we get 
Lat+pro*%+qrza=0 or LYat=—-prXa’?—4q(0) (iv) 
Now squaring (i), we get 
O+P+y+2ab+py+ya)=0 or Ya?=-2p [by (ii)] 
Hence, substituting the value of X@? in (iv), we obtain 


Lat =— p(— 2p) = 2p* 


Exercises 2.1 


1. Form the equation of the fourth degree whose roots are 3 + i and at. 


2. Solve the equation: 
(i) x° + 6x + 20 =0, one root being 1 + 3i. 
(ii) x* — 2x3 — 22x? + 62x — 15 = 0 given that 2 + V3 is a root. 
3. Show that x7 — 3x* + 2x? - 1 = 0 has at least four imaginary roots. 
4. The equation x* - 4x° + ax” + 4x + b = 0 has two pairs of equal roots. Find 
the values of a and b. 
Solve the equations (5-7): 
5. 2x* - 3x° - 9x? + 15x- 5 = 0, given that the sum of two of its roots is zero. 


6. x° — 4x? — 20x + 48 = 0 given that the roots @ and # are connected by the 
relation a + 28 = 0. 
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7.x° — 12x? + 39x — 28 = 0, roots being in arithmetical progression. 


8. O, A, B, C are the four points on a straight line such that the distances of 
A, B, C from O are the roots of equation ax* + 3bx? + 3cx + d = 0. If B is 
the middle point of AC, show that a7d - 3abc + 2b° = 0. 


9. Ifa, B, y are the roots of the equation x° + 4x - 3 = 0, find the value of 
at+ptlty, 


2.3 Transformation of Equations 


1. To find an equation whose roots are m times the roots of the given 
equation, multiply the second term by m, third term by m? and so on (all 
missing terms supplied with zero coefficients). 

For instance, let the given equation be 
3x? + 6x? + 4x? — 8x +11 =0 (i) 


To multiply its roots by m, put y = mx (or x = y/m) in (i). Then 


3(y/m)* + 6(y/m)> + 4(y/m)? — 8(y/m) + 11 =0 
or multiplying by m*, we get 
3y* + m(6y*) + m(4y?) -— m3(y) + m4(11) =0 
This is same as multiplying the second term by m, third term by m?, and 
so on in (i). 


Cor. To find an equation whose roots are with opposite signs to those of 
the given equation, change the signs of every alternative term of the given 
equation beginning with the second. 


Changing the signs of roots of (i) is same as multiplying its roots by — 1. 
. The required equation will be 
3xt + (— 1)6x? + (— 1)24x? - (- 1)3 8x + (- 1)411=0 


or 3x* — 6x? + 4x° + 8x + 11 =0 
which is (i) with signs of every alternate term changed beginning with the 
second. 


2. To find an equation whose roots are reciprocal of the roots of the given 
equation, change x to 1/x. 
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EXAMPLE 2.7 


Solve 6x°-llx? — 3x + 2 = 0, given that its roots are in harmonic 
progression. 


Solution: 


Since the roots of the given equation are in H.P., the roots of the equa- 
tion having reciprocal roots will be in A.P. 


.. The equation with reciprocal roots is 
6(1/x)? - 1101/4)? - 3(11/x) +2 =0 
or I2x° — 3x? - 11x +6=0 (i) 


Since the roots of the given equation are in H.P., therefore, the roots 
of (i) are in A.P. 


Let the roots be a - d, a, a +d. Then 3a = 3/2 and a(a? - d?) = - 3. 


Solving these equations, we get a = 1/2, d = 5/2. Thus the roots of (i) 
are —2, 1/2, 3. 


Hence the roots of the given equation are - 1/2, 2, 1/3. 


EXAMPLE 2.8 


If a, B, y be the roots of the cubic x° - px? + qx - r = 0, form the equation 
whose roots are By + I/a, ya + 1/8, aB + L/y. 
Solution: 


If x is a root of the given equation and y, a root of the required equa- 
tion, then 
Loy +l etl) or tl 
a a a x 


(. apy =r) 


y= py+ 


Thus x = (r+ L)/y. 


Substituting this value of x in the given equation, we get 


(Hy (+) (#1) 
—p +q —r=0 
y y y 


or ry® - q(r + ly? +p(r + 1)y - (r+ 1 =0 


which is the required equation. 
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3. Reciprocal equations. If an equation remains unaltered on changing x to 
be Ix, it is called a reciprocal equation. 
Such equations are of the following types: 


(i) A reciprocal equation of an odd degree having coefficients of terms 
equidistant from the beginning and end equal. It has a root = - 1. 


(ii) A reciprocal equation of an odd degree having coefficients of terms 
equidistant from the beginning and end equal but opposite in sign. 
It has a root = 1. 


(iii) A reciprocal equation of an even degree having coefficients of terms 
equidistant from the beginning and end equal but opposite in sign. 
Such an equation has two roots = | and -1. 


The substitution x + 1/x = y reduces the degree of the equation to half 
its former degree. 


EXAMPLE 2.9 
Solve: (i) 6x° — 41x4 + 97x - 97x? + 41x - 6 =0 
(ii) 6x® — 25x° + 31x! — 31x? + 25x - 6 =0. 
Solution: 
(i) This is a reciprocal equation of odd degree with opposite signs. 
“. «= Lis a root. 
Dividing L.H.S. by x - 1, the equation reduces to 
6x4 — 35x° + 62x? - 35x +6 =0 


Dividing by x’, we have of + | - 35(. + ~) +62=0 
x x 


1 
Putting x +—=yand x” reer —2, we get 
x i 


6(y? — 2) — 35y + 62 =0 or 6y2 — 35y +50=0 
or (3y — 10)(2y — 5) =0 gh oe aed? 
x 3 2 
ie., 3x7?-10x+3=0 or 2x7 -5x+2=0 
ie., (38x-LD(x-3)=0 or (2x —1)(x -2) =0 


1 1 
1 2=5,3 x=X,2 
x 3 or Xx 5) 
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Hence the roots are Lo 852 

(ii) This is a reciprocal equation of even degree with opposite signs. 
“. «= 1,- 1 are its roots. 

Dividing L.H.S. by x — 1 and x + 1, the given equation reduces to 
6x4 — 25x3 + 37x? — 25x + 6 = 0. 


2, Ll 1 
Dividing by x’, we get of? + =] - 25(1 + | +37=0 
x : 
1 ae 
Putting x+—=y and x og y —2, it becomes 


Gy? — 25y + 25=0 or (2y — 5)(3y — 5) =0 


Lé., 2x? — Bx +2 =0 or 3x? - 5x + 3=0 
5+,/(-11) 


5+iVll 
6 


at or x= 


6 
Hence the roots are 1, — 1, 2, i 
9) > 


2.4 Synthetic Division of a Polynomial 
by A Linear Expression 


The division of the polynomial f(x) = ax" + a,x"! tax"? ++ +a x + 


a, by a binomial x — @ is affected compactly by synthetic division as follows: 


hy Gy eG es a, 
ab, ab, 7 ab, , ab, _, ° 
ay a+ ab, ast ab, _ Gs * ab. ae ab,_, 
(=b,) (=b,) (=b,_,) (=R) 


Hence quotient =b,x"! + b,x"? +--+. +b _, and remainder = R 
Explanation: 


(i) Write down the coefficients of the powers of x (supply- 
ing missing powers of x by zero coefficients) and write @ on 
extreme right. 
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(ii) Put a, (= b,) as the first term of 3rd row and multiply it by a and 
write the product under a, and add, giving a, + ab, (=b,). 

(iti) Multiply b, by a and write the product under a, and add, giving 
a, + ab, (=b,) and so on. 


(iv) Continue this process until we get R. 


1. To diminish the roots of an equation f(x) = 0 by h, divide f(x) by x - h 
successively. Then with the successive remainders, determine the coef- 
ficients of the required equation. 

Let the given equation be 


OP PE te te eta, =O (Gi 
To diminish its roots h, put y =x - h (orx =y +h) in (i) so that 
a,ythpta, yth)y't+---+a =0 (ii 
On simplification, it takes the form 
Ay tAy+-+A,=0 (iii 


Its coefficients A,, A,, ---, A, can easily be found with help of synthetic 
division. For this, we put y =x — h in (iii) so that 
Alx=—h)! +A =hy to tA =O 
Clearly (i) and (iv) are identical. If we divide L.HLS. of (iv) by x - h, the 
remainder is A, and the quotient 0 = A, (x -h)"'+A, (x -h)"'+-+A_.. 
Similarly if we divide Q by x - h, the remainder is A,_, and the quotient is 


Q, (say). Again dividing Q, by x - h, A,_, will be obtained and so on. 


NOTE Obs. To increase the roots by h, we take h negative. 


EXAMPLE 2.10 
Transform the equation x° - 6x? + 5x + 8 = 0 into another in which the 
second term is missing. 
Solution: 
Sum of the roots of the given equation = 6. 


Due to the fact that the second term in the transformed equation is 
missing, the sum of the roots will be zero. 

Since the equation has 3 roots, if we decrease each root by 2, the sum of 
the roots of the equation will become zero. To diminish the roots by 2, we 
divide x? — 6x? + 5x + 8 by x — 2 successively. 
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1 6 5 8 
2 8 6 2 
aA 3 2 
2 4 
“9 7 
2 
1 0 


Thus the transformed equation is x° - 7x + 2 = 0. 


2. Synthetic division of a polynomial by a quadratic expression. The 
division of the polynomial f(x) by the quadratic x” - ax - B is carried out 
by the following synthetic scheme: 


d, d, a, aya, d, a 
ab, ab, ab,.-- ab, B 
pb, Bb, s+ BD. pb, 
a, a,+ab, a,+ ab,+ Bb,> a,+ ab,* Bb,,--| a,+ Bb, 
(=b,) (<b) — (=b,) (=b,) --(=b,_,)b,) 


Hence the quotient = b, x"? +b, x"°+.+--+b_, and the remainder 
= bi x + b, 


EXAMPLE 2.11 
Divide 2x° — 3x4 + 4x° — 5x? + 6x - 9 by x* - x + 2 synthetically. 


Solution: 


Hence the quotient = 2x° — x° — x — 4 and the remainder = 4x — 1. 
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Exercises 2.2 


10. 


. Find the equation whose roots are 3 times the roots of x? + 2x? - 4x + 1 =0. 
. Change the sign of the roots of the equation x7 + 3x? +49 - 4? + 7x +1=0. 


. Find the equation whose roots are the negative reciprocals of the roots 


of x* + 7x? + 8&x?-9x + 10 =0. 


. Solve the equation 81x° - 18x? - 36x + 8 = 0, given that its roots are in 


HP. 


. Solve: (i) 6x° + x? -— 43x° - 43x? +4 +6 =0. 


(ii) 4x* — 20x° + 33x? - 20x +4 = 0. 


. Find the equation whose roots are the roots of: x* +? - 3x? -x + 2=0 


each diminished by 3. 


. Show that the equation x* - 10x? + 23x? - 6x - 15 = 0 can be transformed 


into a reciprocal equation by diminishing the roots by 2. Hence solve the 
equation. 


. Find the equation of squared differences of the roots of the cubic 
3+ 6x2 + 7x +2=0. 


. Ifa, B, y are the roots of the fe 2x° + 3x2 -—x- 1 =0, form the 


equation whose roots are (1 - a@)7!, (1 - 6)"', and (1 - y)'. 


Divide 15x7 - 16x° + 30x° - 3x4 - 5x? - 2x? + 5x + 8 by x? - x + 1 syntheti- 
cally. 


2.5 Iterative Methods 


The limitations of analytical methods for the solution of equations 


have necessitated the use of iterative methods. An iterative method begins 
with an approximate value of the root which is generally obtained with the 
help of Intermediate value property of the equation (Section 2.2). This 
initial approximation is then successively improved iteration by iteration 
and this process stops when the desired level of accuracy is achieved. The 
various iterative methods begin their process with one or more initial ap- 
proximations. Based on the number of initial approximations used, these 
iterative methods are divided into two categories: Bracketing Methods 
and Open-end Methods. 


2.6 
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Bracketing methods begin with two initial approximations which brack- 
et the root. Then the width of this bracket is systematically reduced until 
the root is reached to desired accuracy. The commonly used methods in 
this category are: 


1. Graphical method 


2. Bisection method 


3. Method of False position. 


Open-end methods are used on formulae which require a single starting 
value or two starting values which do not necessarily bracket the root. The 
following methods fall under this category: 


1. Secant method 

. Iteration method 

. Newton-Raphson method 
. Muller’s method 


. Horner’s method 


an nan fF WO N 


. Lin-Bairstow method. 


Graphical Solution of Equations 


Let the equation be f(x) = 0. 

(i) Find the interval (a, b) in which a root of f(x) = 0 lies. 
(ii) Write the equation f(x) = 0 as @ (x) =p (x) 

where p(x) contains only terms in x and the constants. 


(iii) Draw the graphs of y = @ (x) and y = @ (x) on the same scale and 
with respect to the same axes. 


(iv) Read the abscissae of the points of intersection of the curves y = 
(x) andy =y 
These are the initial approximations to the roots of f(x) = 0. 


Sometimes it may not be convenient to write the given equation f(x) = 0 
in the form @ (x) = (x). In such cases, we proceed as follows: 


(i) Form a table for the value of x and y = f(x) directly. 
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(ii) Plot these points and pass a smooth curve through them. 
(iit) Read the abscissae of the points where this curve cuts the x-axis. 


These are rough approximations to the roots of f(x) = 0. 


EXAMPLE 2.12 


Find graphically an approximate value of the root of the equation 
3-x=erh 
Solution: 
Let fix) =e"! +x-3=0 (i) 
fll) =14+1-3=- ve and 
f(2)=e+2-3=2.718 -l=+ve 
“. A root of (i) lies between x = 1 and x = 2. 


Let us write (i) as e*!=3-x. 
The abscissa of the point of intersection of the curves 

y=er! (ii) 
and y=3-x (iti) 
will give the required root. 


To plot (ii), we form the following table of values: 


x 11} 12) 138 ] 14 ] 15 | 16] 17 |] 18 7) 19 | 20 


y=e™'| 1.11 | 1.22 | 1.35 | 1.49 |] 1.65 | 1.82 | 2.01 | 2.23 | 2.46 | 2.72 


Taking the origin at (1, 1) and 1 small unit along either axis = 0.02, 


we plot these points and pass a smooth curve through them as shown in 
Figure 2.2. 


To draw the line (iii), we join the points (1, 2) and (2, 1) on the same 


scale and with the same axes. 


From the figure, we get the required root to be x = 1.44 nearly. 
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L8 


1.6 


L4 


(1, 1) 12 14 16 18 2.0 
FIGURE 2.2 


EXAMPLE 2.13 
Obtain graphically an approximate value of the root of x = sin x + 77/2. 
Solution: 
Let us write the given equation as sin x = x — 77/2. 


The abscissa of the point of intersection of the curve y = sin x and the 
line y =x - 2/2 will give a rough estimate of the root. 


To draw the curve y = sin x, we form the following table: 


36 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


Ce [0 [aa [oe [Soa 


ry fo font fon fo 


Taking 1 unit along either axis = 27/4 = 0.8 nearly, we plot the curve as 
shown in Figure 2.3. 


Also we draw the line y = x - 2/2 to the same scale and with the same 
axes. From the graph, we get x = 2.3 radians approximately. 


YA 


1/2, 


FIGURE 2.3 


EXAMPLE 2.14 


Obtain graphically an approximate value of the lowest root of 


cos x cosh x = — 1. 
Solution: 
Let fix) =cos x coshx +1=0 (i) 


f(0) =+ ve, fla/2)=+ve and m=- ve. 
“. The lowest root of (i) lies between x = 7/2 and x =z. 
Let us write (i) as cos x = — sech x. 
The abscissa of the point of intersection of the curves 
y = COs X (ii) 


and =-sechx (iti) 
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will give the required root. 


To draw (ii), we form the following table: 


X= m/2 = 1.57 31/4 = 2.36 m=3.14 


y = COS X 0 -0.71 -l 


Taking the origin at (1.57, 0) and 1 unit along either axis = 2/8, = 0.4 
nearly, we plot the cosine curve as shown in Figure 2.4. 


x=3.14 


y'yY 
FIGURE 2.4 
To draw (iii), we form the following table: 


x 1.57 2.36 3.14 
cosh x 2.51 5.34 11.57 
y = -sechx —0.4 -0.19 —0.09 


Then we plot the curve (iii) to the same scale with the same axes. 


From the above figure, we get the lowest root to be approximately 
x = 1.57+ 0.29 = 1.86. 


Exercises 2.3 


Find the approximate value of the root of the following equations 


graphically (1-4): 
1.*2°-x-1=0 
2. x° — 6x7 + 9x- 3 =0 
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3.tanx=1.2x 
4.x =3 cos (x - 7/4). 


2.7 Rate of Convergence 


S, steenis be the values of a root (@) of an equation at the Oth, 
Ist, 2nd ....... iterations while its actual value is 3.5567. The values of this 
root calculated by three different methods, are as given below: 


Root Ist method 2nd method 3rd method 
x, 5 5 5 
x, 5.6 3.8527 3.8327 
ms 6.4 3.5693 3.56834 
Xs 8.3 3.55798 3.55743 
x, 9.7 3.55687 3.55672 
X, 10.6 3.55676 
Xx. 11.9 3.55671 


6 

The values in the Ist method do not converge toward the root 3.5567. 
In the 2nd and 3rd methods, the values converge to the root after 6th and 
Ath iterations, respectively. Clearly 3rd method converges faster than the 
2nd method. This fastness of convergence in any method is represented by 
its rate of convergence. 

If e be the error then e, = a — x, =x,,, —%, 


If e,, /e, is almost constant, convergence is said to be linear, i.e., slow. 


F If e,,/e, is nearly constant, convergence is said to be of order p, i.e., 
aster. 


2.8 Bisection Method 


This method is based on the repeated application of the intermediate 
value property. Let the function f(x) be continuous between a and b. For 
definiteness, let f(a) be negative and f (b) be positive. Then the first approxi- 


1 
mation to the root is x; = 94 +b). 
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YA 


f(b) 


>Y 


FIGURE 2.5 


Iff (x,) =0, then x, is a root of f (x) = 0. Otherwise, the root lies between 
a and x, or x, and b according as f (x,) is positive or negative. Then we bisect 
the interval as before and continue the process until the root is found to 
desired accuracy. 


In the Figure 2.4, f(x,) is + ve, so that the root lies between a and x.. 


Then the second approximation to the root is x, = La (ore). Pe 
~ 2 


the root lies between x, and x,. Then the third approximation to the root is 
xX, = i (x, + x,) and so on. 

5 2 
NOTE Obs. 1. Since the new interval containing the root, is exactly 
—__ half the length a the previous one, the interval width is reduced 


by a factor of 6 at each step. At the end of the nth step, the new 


interval will therefore, be of length (b - a)/2". If on repeating 
this process n times, the latest interval is as small as given € then 
(b -a)/2"<é 

or n = [log (b - a) - log e Vlog 2. 

This gives the number of iterations required for achieving an 
accuracy &. 

In particular, the minimum number of iterations required for 
converging to a root in the interval (0, 1) for a given € are as 
under: 

e 10° 10? 10> 

n: 7 10 14 
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Rate of Convergence. As the error decreases with each step by a 


factor of —,,(i.e., e, /e, = 3 ), the convergence in the bisection method is 
linear. 


EXAMPLE 2.15 


(a) Find a root of the equation x* - 4x - 9 = 0, using the bisection 
method correct to three decimal places. 


(b) Using bisection method, find the negative root of the equation 
x? - 4x+9=0. 


Solution: 
(a) Let fix) =x° — 4x - 9 
Since f(2) is - ve and f(3) is + ve, a root lies between 2 and 3. 
.. First approximation to the root is 
x= ; (24+3)=2.5. 
Thus f (x,) = (2.5)? - 4(2.5) - 9 = - 3.375 i.e., -ve. 


. The root lies between x, and 3. Thus the second approximation to 
the root is 


a, = ; (x, +3) =2.75. 
Then f (x,) = (2.75) - 4(2.75) - 9 = 0.7969 i.e., +ve. 
.. The root lies between x, and x,. Thus the third approximation to the 
root is , 
X= 1 (x, +x,) = 2.625. 
Then f (x,) = (2.625)? - 4(2.625) - 9= - 1.4121li.e., -ve. 
The root lies between x, and x,. Thus the fourth approximation to the 
root is 


1 
. (x, +2x,) = 2.6875. 


Repeating this process, the successive approximations are 


X= 


x, = 2.71875, x, = 2.70313, x, = 2.71094 
x, = 2.70703, x, = 2.70508, X,) = 2.70605 
x,, = 2.70654, x, = 2.70642 


Hence the root is 2.7064. 
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(b)If a, B, y are the roots of the given equation, then - a, - f, - y are 
the roots of (- x)® - 4(- x) +9=0 


“The negative root of the given equation is the positive root of 
x° — 4x -9 = 0 which we have found above to be 2.7064. 


EXAMPLE 2.16 


Using the bisection method, find an approximate root of the equation 
sin x = 1/x, that lies between x = 1 and x = 1.5 (measured in radians). Carry 
out computations up to the 7th stage 


Solution: 

Let f(x) =x sin x — 1. We know that 1’ = 57.3°. 

Since f(1)=1 x sin(1) — 1 = sin (57.3°) — 1 =— 0.15849 

and = f(1.5) = 1.5 x sin (1.5)r — 1 = 1.5 x sin (85.95)° — 1 = 0.49625; 
a root lies between | and 1.5. 


.. First approximation to the root is x, = ; (1+ 1.5) =1.25 


Then f(x,) = (1.25) sin (1.25) — 1 = 1.25 sin (71.625°) — 1 = 0.18627 and 
jf) <0. 
.. A root lies between | and x, = 1.25. 


Thus the second approximation to the root is x2 = = (1 + 1.25) = 1.125. 


Wile 


°—]=0.01509 and 


wo 


Then f(x,) = 1.125 sin (1.125) — 1 = 1.125 sin (64.46 
fi) < 0. 


.. A root lies between 1 and x, = 1.125. 


Thus the third approximation to the root is x, = = (1 + 1.125) = 1.0625. 


Oe il 


Then f(x,) = 1.0625 sin (1.0625) — 1 = 1.0625 sin (60.88) — 1 =— 0.0718 
< 0 and f(x,) > 0, i.e., now the root lies between x, = 1.0625 and x, = 1.125. 


.. Fourth approximation to the root is x, = ; (1.0625 + 1.125) = 1.09375 
Then fix,) =— 0.02836 < 0 and f(x,) > 0, 

i.e., The root lies between x, = 1.09375 and x, = 1.125. 

.. Fifth approximation to the root is x, = ; (1.09375 + 1.125) = 1.10937 
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Then f(x.) =— 0.00664 < 0 and f(x,) > 0. 
The root lies between x, = 1.10937 and x, = 1.125. 


Thus the sixth approximation to the root is 
x= 5 (1.10937 + 1.125) = 1.11719 


Then f(x,) = 0.00421 > 0. 
But f(x.) < 0. 
The root lies between x, = 1.10937 and x, = 1.11719. 


Thus the seventh approximation to the root is 


x => (1.10937 + 1.11719) = 1.11328 


Hence the desired approximation to the root is 1.11328. 


EXAMPLE 2.17 


Find the root of the equation cos x = xe* using the bisection method 
correct to four decimal places. 


Solution: 
Let fix) = cos x — xe*. 
Since f(0) = 1 and f(1) = — 2.18, so a root lies between 0 and 1. 


.. First approximation to the root is x, = ; (0+1)=0.5 


Nowf(x,) = 0.05 and f(1) =— 2.18, therefore the root lies between 1 and 
x, = 0.5. 

.. Second approximation to the root is x, = ; (0.5 + 1) =0.75 

Now f(x,) =— 0.86 and f(0.5) = 0.05, therefore the root lies between 0.5 
and 0,75. 

.. Third approximation to the root is x, = : (0.5 + 0.75) = 0.625 

Now f(x,) = — 0.36 and f(0.5) = 0.05, therefore the root lies between 0.5 
and 0,625. 

.. Fourth approximation to the root is x, = X (0.5 + 0.625) = 0.5625 


a 
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Now fi(x,) =— 0.14 and 0.5 = 0.05, therefore the root lies between 0.5 
and 0.5625. 


.. Fifth approximation is x, = 1 ; (0.5 + 0.5625) = 0.5312 

Now f(x.) =— 0.04 and f(0.5) = 0.05, therefore the root lies between 0.5 
and 0.5312. 

.. Sixth approximation is x, = is (0.5 + 0.5312) = 0.5156 


a 


Hence the desired approximation to the root is 0.5156. 


EXAMPLE 2.18 
Find a positive real root of x log,,,* = 1.2 using the bisection method. 
Solution: 
Let f(x) =x log,,*— 1.2. 
Since f(2) = — 0.598 and f(3) = 0.231, so a root lies between 2 and 3. 
.. First approximation to the root is x, = (2+3)=2.5. 
Now f(2.5) = — 0.205 and f(3) = 0.231, therefoie a root lies between 2.5 
and 3. 
.. Second approximation to the root is x, = 1 (2.543) =2.75. 


a 


Now f(2.75) = 0.008 and (2.5) = — 0.205, therefore, a root lies between 
2.5 and 2.75. 


.. Third approximation to the root is x, = = (2.5 + 2.75) = 2.625 


1 
2 
Now f(2.625) = — 0.1 and f(2.75) = 0.008, therefore a root lies between 
2.625 and 2.75. 
. Fourth approximation to the root is x4 = ; (2.625 + 2.75) = 2.687 


Hence the desired root is 2.687. 


2.9 Method of False Position or Regula-Falsi Method or 
Interpolation Method 


This is the oldest method of finding the real root of an equation f(x) = 0 
and closely resembles the bisection method. 
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Here we choose two points x, and x, such that f(x,) and f(x,) are of op- 
posite signs i.e., the graph of y = f(x) crosses the x-axis between these points 
(Figure 2.6). This indicates that a root lies between x, and x, and conse- 


quently f (x,) f (x1) < 0. 
Equation of the chord joining the points A[x,, f(x,)] and B[x1, f(x,)] is 


P(si)= Feo) 


xX) —Xo 


w= %) 


y- f(x) = 


FIGURE 2.6 


The method consists in replacing the curve AB by means of the chord 
AB and taking the point of intersection of the chord with the x-axis as an 
approximation to the root. So the abscissa of the point where the chord cuts 
the x-axis (y = 0) is given by 


Xg ~ XQ = 


Fa=#G) ” 


which is an approximation to the root. 


If now f (x,) and f (x,) are of opposite signs, then the root lies between x, 
and x,. So replacing x, byx, in (1), we obtain the next approximation x,. (The 
root could as well lie between x, and x, and we would obtain x, accordingly). 
This procedure is repeated until the root is found to the desired accuracy. 
The iteration process based on (1) is known as the method of false position. 
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Rate of Convergence. This method has linear rate of convergence 
which is faster than that of the bisection method. 


EXAMPLE 2.19 


Find a real root of the equation x? — 2x — 5 = 0 by the method of false 
position correct to three decimal places. 


Solution: 
Let fx) == 22-5 
so that f(2) =— Land f (3) = 16, 


i.e., A root lies between 2 and 3. 

.. Taking x, = 2, x, = 3, f (x,) =— 1, flx,) = 16, in the method of false 
position, we get 

Xx) — Xo 
f (x)— f(x) 
Now f(x?) =f (2.0588) = — 0.3908 
ie., The root lies between 2.0588 and 3. 
. Taking x, = 2.0588, x, = 3, f(x,) = — 0.3908, fix,) = 16, in (i), we get 

0.9412 


19.3908 
Repeating this process, the successive approximations are 


x, = 2.0862, x, = 2.0915, X, = 2.0934, 
x, = 2.0941, x, = 2.0943 etc. 


Hence the root is 2.094 correct to three decimal places. 


1 
Xx =Xq — f(x)=2+ 77 = 2.0588 (i) 


x3 = 2.0588 — (—0.3908) = 2.0813 


EXAMPLE 2.20 


Find the root of the equation cos x = xe* using the regula-falsi method 
correct to four decimal places. 


Solution: 
Let fix)=cosx—xe*=0 
so that f(0) = 1, f (1) =cos 1 -—e =— 2.17798 
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i.e., the root lies between 0 and 1. 


“. Taking x, =0,«, =1,f (x,) = 1 andf(x,) =— 2.17798 in the regula-falsi 
method, we get 


1 
Xp =Xy) — xX, ) = 0 +——— X 1 = 0.31467 j 
Xp = Xo yf (0) 3.17798 (i) 


f(x ) — f(a, 
Now f(0.31467) = 0.51987 i.e., the root lies between 0.31467 and 1. 


“. Taking x, = 0.31467, x, = 1, f(x,) = 0.51987, flx,) = — 2.17798 in (i), 
we get 
0.68533 


2.69785 
Now f(0.44673) = 0.20356 i.e., the root lies between 0.44673 and 1. 


“. Taking x, = 0.44673, x, = 1, f (x,) = 0.20356, flx,) = — 2.17798 in (i), 
we get 


x3 = 0.31467 + X 0.51987 = 0.44673 


0.55327 

2.38154 

Repeating this process, the successive approximations are 
x, = 0.50995, x, =0.51520, x, = 0.51692 

x,= 0.51748, x, =0.51767, x, =0.51775 etc. 


Hence the root is 0.5177 correct to four decimal places. 


X 0.20356 = 0.49402 


x4 = 0.44673 + 


EXAMPLE 2.21 


Find a real root of the equation x log,,x = 1.2 by regula-falsi method 
correct to four decimal places. 


Solution: 
Let f(x) =x log10x — 1.2 
so that f(l) =— ve, f(2) =— ve and f(3) = + ve. 


.. A root lies between 2 and 3. 
Taking x, = 2 and x, = 3, fix,) = — 0.59794 and f(x,) = 0.23136, in the 
method of false position, we get 


f (xy) = 2.72102 (i) 
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Repeating this process, the successive approximations are 


x, = 2.74024, x, = 2.74063 ete. 
Hence the root is 2.7406 correct to 4 decimal places. 


EXAMPLE 2.22 
Use the method of false position, to find the fourth root of 32 correct 


to three decimal places. 


Solution: 
Let x = (32) so that x4 — 32 =0 


Take f(x) = x* — 32. Then f(2) = — 16 and f(3) = 49, i.e., a root lies be- 


tween 2 and 3. 
“. Taking x, = 2, x, = 3, f(x,) = — 16, f(x,) = 49 in the method of false 


(i) 


position, we get 
t= % 16 
“17 *0 f(x) = 24 gg 7 2262 


Xy =Xy — 
° . f(m)—Ff (xo) 
Now f(x,) =f(2.2462) = — 6.5438 i.e., the root lies between 2.2462 and 3. 
.. Taking x, = 2.2462, x, = 3, f(x,) = — 6.5438, f(x,) = 49 in (i), we get 
3-— 2.2462 
X4 = 2.2462 — ———_ (-— 6.5438) = 2.335 
49 + 6.5438 
Now f(x,) =f(2.335) = — 2.2732 i.e., the root lies between 2.335 and 3. 
”. Taking x, = 2.335 and x, = 3, f(x,) = — 2.2732 and f(x,) = 49 in (i), we 
obtain 
X4 = 2.335 — 372.335 _(_» 9739) = 9.3645 
49 + 2.2732, 
Repeating this process, the successive approximations are x; = 


2.3770, x, = 2.3779 etc. Since x, = x, upto three decimal places, we take 


(32) = 2.378. 


2.10 Secant Method 


This method is an improvement over the method of false position as it 
does not require the condition f(x,) flx,) < 0 of that method (Figure 2.5). 
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Here also the graph of the function y =f (x) is approximated by a secant line 
but at each iteration, two most recent approximations to the root are used 
to find the next approximation. Also it is not necessary that the interval must 
contain the root. 


Taking x,, x, as the initial limits of the interval, we write the equation of 
the chord joining these as 
(x )= P(si)= Flo) ( Se ) 
y—f (x)= ns Cannes 
xX) = Xo 
Then the abscissa of the point where it crosses the x-axis (y = 0) is given 
by 
xX) 7 Xo 


f(x)—f (a) 


which is an approximation to the root. The general formula for succes- 
sive approximations is, therefore, given by 


X9 


f(x) 


eee | ial cle ; S 
Xn+1 Xn f(x, )—-f (x, Tay fen) nL. 

Rate of Convergence. If at any interation f(x,) = f(x, _,), this method 
fails and shows that it does not converge necessarily. This is a drawback of 
secant method over the method of false position which always converges. 
But if the secant method once converges, its rate of convergence is 1.6 
which is faster than that of the method of false position. 


EXAMPLE 2.23 
Find a root of the equation x*° — 2x — 5 = 0 using the secant method cor- 
rect to three decimal places. 
Solution: 
Let f(x) =x? — 2x — 5 so that f(2) =— 1 and f(3) = 16. 


.. Taking initial approximations x, = 2 and x, = 3, by the secant method, 
we have 


Xy = xy — yf (si) =8~ Fey 16 = 2.058828 


f(x) —F (x 16+1 
Now _ f(x,) =— 0.390799 
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ty =X) -— 2 vf (x)= 2.081263 


fe)=7 
and filx,) =— 0.147204 


X4 =X3 —- f (x3) = 2.094824 


and —f(x,) = 0.003042 


Xs =Xy— f (x,) = 2.094549 


Fla)=F Ga) 


Hence the root is 2.094 correct to three decimal places 


EXAMPLE 2.24 


Find the root of the equation xe* = cos x using the secant method cor- 
rect to four decimal places. 


Solution: 

Let fix) =cosx—xe*=0. 

Taking the initial approximations x, = 0, x, = 1 
so that f (x,) = 1, f (x,) =cos 1 - e =— 2.17798 
Then by the secant method, we have 


X1 — Xp 1 


== FG of, ! =! +S irtes 
Now _ f (x,) = 0.51987 


(—2.17798) = 0.31467 


X4 =X — Hasay = 0.53171 


Repeating this process, the successive approximations are x, = 0.51690, 
X, = 0.51775, x, = 0.51776 ete. 


Hence the root is 0.5177 correct to four decimal places. 
Obs. Comparing Examples 2.18 and 2.21, we notice that the 


rate of convergence in the secant method is definitely faster 
than that of the method of false position 


NOTE 
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2.11 Iteration Method 


To find the roots of the equation f(x) = 0 (i) 
by successive approximations, we rewrite (i) in the formx =@(x) (ii) 


The roots of (i) are the same as the points of intersection of the straight 
line y =x and the curve representing y = @(x).Figure 2.7 illustrates the 
working of the iteration method which provides a spiral solution. 


Let x =x, be an initial approximation of the desired root a. Then the 
first approximation x, is given by x, = P(x,) 
Now treating x, as the initial value, the second approximation is 


x, = (x,) 


Proceeding in this way, the nth approximation is given by x, = @(x,_,) 


0 % xy, X 


FIGURE 2.7 


Sufficient condition for convergence of iterations. It is not certain 
whether the sequence of approximations x,, x,,...,x,, always converges to the 
same number which is a root of (1) or not. As such, we have to choose the 
initial approximation x, suitably so that the successive approximations x,, 
X,,.., x, converge to the root @. The following theorem helps in making the 
right choice of x,: 


Theorem: 

[f (i) a be a root of f (x) = 0 which is equivalent to x = $(x), 
(ii) I, be any interval containing the point x = a, 

(iii) |@’(x) | < L for allx in I, 


then the sequence of approximations x,, x, X,,..., x, will converge to the 
root a provided the initial approximation x, is chosen in I. 
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Proof. Since @ is a root of x = f(x), we have a = @(@) 


Ifx_, and xn be 2 successive approximations to a, we have xn = $(x,_,) 
x, -a= (x, ,)-(@) (i) 
wy) (x,-1 ) =; p(a) 


Xn-1 — a 


= @'(E) where 186 <a 


By mean value theorem, 


Hence (1) becomes x, — @ = (x,_, — &) ’(@) 
If| @’(x,) | <k < 1 for alli, then 
-a| (2) 


=a |\Sk |e oa | 


ee | Ske. 


Similarly | x 


n-l 


ie, |x -a|<k*|x_,-a| 


n-2 


Proceeding in this way, |x, -a|<k"|x,-a | 
As n — 0, the R.HLS. tends to zero, therefore, the sequence of approxi- 


mations converges to the root a. 


Obs. 1. The smaller the value of $’(x), the more rapid will be 
the convergence. 

2. This method of iteration is particularly useful for finding the 
real roots of an equation given in the form of an infinite series. 


NOTE 


Acceleration of convergence. From (2), we have 
kel. 
It is clear from this relation that the iteration method is linearly conver- 


gent. This slow rate of convergence can be improved by using the following 
method: 


Aitken’s A’ method. Let x,_,, x,, x,,, be three successive approxima- 


tions to the desired root @ of the equation x = @(x). Then we know that 


Fie 2d a a 


a-x,=k(a—x,,),a@—-x,,=k(a-x,) 


Dividing, we get OF Ute 


GE, “Oey 


2 


Na, —x,) 
Whence @ = Xj4) — aa Cries (3) 


Xj41 — 2X; =X 
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But in the sequence of successive approximations, we have 


A’x, = A(Ax,) = A(x 


itl afi i+1 i 


- Xi.9 = Xia = Gea X= 
Ax =x, , — 2x, +x, 
i+] i i-l 
2 
: (Ax) 
Hence (3) can be written as @=x,,, — a 
Xi-1 


which yields successive approximations to the root @. 


EXAMPLE 2.25 
Find a real root of the equation cos x = 3x — 1 correct to three decimal 
places using 
(i) Iteration method 
(ii) Aitken’s A? method. 
Solution: 
(i) We have f(x) = cos x — 3x + 1=0 
f(0) =2=+ ve and f(a/2) =- 3 27/2+1=-ve 
. A root lies between 0 and 7/2. 
Rewriting the given equation as x = - (cos x + 1) = @(x), we have 


sinx 


d (x)= - 


Hence the iteration method can be applied and we start with x0 = 0. 
Then the successive approximations are, 


1 
and | ¢'(x) | = | sine |<lin (0,7/2). 


x, = (x0) = ; (cos 0 + 1) = 0.6667 

x, =@(el) = : (cos 0.6667 + 1) = 0.5953 
x, = O(x2) = - (cos 0.5953 + 1) = 0.6093 
x, = (x3) = ; (cos 0.6098 + 1) = 0.6067 
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x, = (x4) = — (cos 0.6067 + 1) = 0.6072 


(cos 0.6072 + 1) = 0.6071 


wl wlr 


X_= (x5) = 


Hence x, and x, being almost the same, the root is 0.607 correct to three 
decimal places. (ii) We calculate x,, x,, x, as above. To use Aitken’s method, 
we have 


x Ax A’x 
x, = 0.667 
— 0.0714 
x, = 0.5953 0.0854 
0.014 
x, = 0.6093 
5 
Ax, ) 0.014)" 
Hence Ny =X3— (os). = 0.6093 — Oo = 0.607 
Ne, 0.0854 


which corresponds to six iterations in normal form. 


Thus the required root is 0.607. 


EXAMPLE 2.26 


Using iteration method, find a root of the equation x? + x? — 1 = 0 cor- 
rect to four decimal places. 


Solution: 

We have f(x) =x° +2?-1=0 

Since f(0) = — 1 and f(1) = 1, a root lies between 0 and 1. 

Rewriting the given equation as x = (x + 1)—'? = (x), we have (x) = 
- 5 (i + 1)? and | $’(x) | < 1 forx < 1. Hence the iteration method can be 


applied. Starting with x, = 0.75, the successive approximations are 


1 
x, = O(xXy) = ———— - = 0.7559 
P(x) is i : (0.75466 
Xo = x,/= > —] =F V- 
. “(0.7559 +1) 


x, = 0.75492, x, = 0.75487, x, = 0.75488 


Hence x, and x, being almost the same, the root is 0.7548 correct to 
four decimal places. 
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EXAMPLE 2.27 


Apply iteration method to find the negative root of the equation x° — 2x 
+5=0 correct to four decimal places. 


Solution: 
If a, B, y are the roots of the given equation, then — a, — B, — y are the 
roots of 
(—x)®-2(-x)+5=0 
. The negative root of the given equation is the positive root of 
f (x) =2° =2c =5=0. (i) 
Since f(2) =— 1 and f (3) = 16, a root lies between 2 and 3. 
Rewriting (i) as x = (2x + 5)! =@(x), 
we have $’(x) = = (2x + 5)—**, 2 and | p’(x) | < 1 forx < 3. 
. The iteration method can be applied: 
Starting with x, = 2. The successive approximations are 
x, =@x,) = (2x, + 5)!” = 2.08008 
x, = @lx,) = 2.09235, x, = 2.09422 
x, = 2.09450, x, = 2.09454 


Since x, and x, being almost the same, the root of (i) is 2.0945 correct 
to four decimal places. 


Hence the negative root of the given equation is — 2.0945. 


EXAMPLE 2.28 


Find a real root of 2x — log,,x = 7 correct to four decimal places using 
the iteration method. 


Solution: 

We have f(x) = 2x — log,,x — 7 
fl3) =6 - log, 3-7 =6 - 0.4771 -7=- 1.4471 
fl4) = 8 — log, ¢- 7 = 8 - 0.602 — 7 = 0,398 

. A root lies between 3 and 4. 
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Rewriting the given equation as x = 5 (log, x + 7) =(x), we have 
eal 
Q(x) = {lo | 
2\x 
“| @(x) |< Lwhen3<x<4 [-. log, ,e = 0.434: ] 
Since | f(4)| < | (3) 


Hence the iteration method can be applied. Taking x, = 3.6, the succes- 
sive approximations are 


x, =@ (x,) = = 3 (logo 3.6 + 7) =3.77815 
(log10 3.77815 + 7) = 3.78863 


(log 3.78863 + 7) = 3.78924 


ae cea 


x,=9 (x,) = > (log 3.78924 + 7) = 3.78927 


Hence x, a x, being almost equal, the root is 3.7892 correct to four 
decimal places. 


EXAMPLE 2.29 


Find the smallest root of the equation 


2 3 4 a) 
x x x x 


s-— ts - Ht 
(C1) a Ch) el C2) 


l-xt+ 


Solution: 
Writing the given equation as 


2 3 4 
x x x 


Sera er 
(21° (aly? (41° “ey 


Omitting x* and higher powers of x, we get x = 1 approximately. 


= $(x) 


x=1+ 


Taking x, = 1, we obtain 


1 1 1 1 
= Oo)=14 G-GEt GD Gt 
— éa)= = 2 ea oe _ SE) 

(2!) (3!) (4!) (5!) 


= 1.2239 


+++ = 1.3263 
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Similarly x, = 1.38, x, = 1.409, x, = 1.425 
x,=1434, x, =1.430, x, = 1.442. 


The values of x, and x, indicate that the root is 1.44 correct to two deci- 
mal places. 


Exercises 2.4 


1. Find a root of the following equations, using the bisection method cor- 
rect to three decimal places: 


(i) x8 -x-1=0 (ii) x8 -x? -1=0 
(iti) 2x3 + x? — 20x + 12 =0 (iv) xt -x —10=0. 
2. Evaluate a real root of the following equations by bisection method: 
(i) x -cosx=0 (ii) ew -—x =0 
(iii) e =4 sin x. 
3. Find a real root of the following equations correct to three decimal 
places, by the method of false position: 
(i)x°-5x+1= (ii) x8 — 4x -9=0 
(iii) x8 —x* -2° -1=0. 


4. Using the regula falsi method, compute the real root of the following 
equations correct to three decimal places: 


(i) xe* =2 (ii) cos x = 3x —1 
(iii) xe* = sin x (iv) x tanx=—- 1 
(v) 2x —-logx=7 

(vi) 3x + sin x = e% 


5. Find the fourth root of 12 correct to three decimal places by the inter- 
polation method. 


6. Locate the root of f (x) =x'° — 1 =0, between 0 and 1.3 using the bisec- 
tion method and method of false position. Comment on which method 
is preferable. 
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7. Find a root of the following equations correct to three decimal places by 
the secant method: 


G)e8+x24+x4+7=0 (ii) x -e* =0 
(iii) x log x = 1.9. 


8. Use the iteration method to find a root of the equations to four decimal 
places: 
(i) x8 +x2- 100 =0 (ii) x3 -9x + 1=0 


(iii) x = : +sinx (iv) tanx =x 
(vo) e =5x (vi) 2°-x — 3 =0 which lies between (- 3, — 2). 


9. Evaluate /30 by (i) secant method (ii) iteration method correct to 
four decimal places. 


10. Find the root of the equation 2x = cos x + 3 correct to three decimal 
places using (i) iteration method, (ii) Aitken’s A* method. 


11. Find the real root of the equation 
ge at ge su 


- - +...= 0.443 
3 10 42 216 1320 


x—- 


correct to three decimal places using iteration method 


2.12 Newton-Raphson Method 


Let x, be an approximate root of the equation f(x) = 0. Ifx, =x, +h be 
the exact root, then f(x,) = 0. 


2 
.. Expanding f(x, + h) by Taylor's series f(x,) +h f(x,) + n f(xy) +++ =0 
Since h is small, neglecting h? and higher powers of h, we get flx,) +h 

('b,) =0 

a (x5) 

i (x ) 

. A closer approximation to the root is given by 

f (x) 

7 (xp) 


(1) 


or h=- 
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Similarly starting with x,, a still better approximation x, is given by 


f(%) 


ty =X — 
_— f'(m) 
£(X,, 
In general, X,4, =X, — wl (n=0, 1, 2...) 


formula. 


NOTE 


Obs. 1. Newton’s method is useful in cases of large values of 

f (x) i.e., when the graph of f(x) while crossing the x-axis is 
nearly vertical. 

For if f (x) is small in the vicinity of the root, then by (1), h will 
be large and the computation of the root is slow or may not be 
possible. Thus this method is not suitable in those cases where 
the graph of f(x) is nearly horizontal while crossing the x-axis. 


Obs. 2. Geometrical interpretation. Let x, be a point near the 
root a of the equation f(x) = 0 (Figure 2.8). Then the equation of 
the tangent at A [x,, f(x,)] is 


Y =f) =f"(x,) a ay): 


It cuts the x-axis at x, =X, —- F(x) 

J (xo) 
which is a first approximation to the root a. If A, is the point 
corresponding to x, on the curve, then the tangent at A, will cut 
the x-axis at x, which is nearer to a and is, therefore, a second 
approximation to the root. Repeating this process, we approach 
the root @ quite rapidly. Hence the method consists in replacing 


FIGURE 2.8 


(2) 


which is known as the Newton-Raphson formula or Newton’s iteration 
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the part of the curve between the point A, and the x-axis by 
means of the tangent to the curve at A, 


Obs. 3. Newton’s method is generally used to improve the 
result obtained by other methods. It is applicable to the solution 
of both algebraic and transcendental equations. 


Convergence of Newton-Raphson Method. Newton’s formula con- 
verges provided the initial approximation x, is chosen sufficiently close to 
the root. 


If it is not near the root, the procedure may lead to an endless cycle. 
A bad initial choice will lead one astray. Thus a proper choice of the initial 
guess is very important for the success of Newton’s method. 


Comparing (2) with the relation xn,, = @(xn) of the iteration method, 


we get 
P(x, ) = Xn4 = Xn _ fv») 
fh) 
In general, o(x)=x—- fe) which gives $'(x)= L@)F"G) 
Since the iteration ee ee 2.10) converges if Ly fal <1 


.. Newton’s formula will converge if| f(x) f(x) | < |f’(x) ? in the interval 
considered. Assuming f(x), f(x) and f “(x) to be continuous, we can select 
a small interval in the vicinity of the root @, in which the above condition is 
satisfied. Hence the result. 


Newtons method converges conditionally while the regula-falsi method 
always converges. However when the Newton-Raphson method converges, 
it converges faster and is preferred. 

Newton’s method has a quadratic convergence. 

Suppose x, differs from the root a by a small quantity €, so that 

x,=ate andx ,=ateé .. 


Then (2) becomes 


flate,) 
filate,) 
flate,) 
f(a@+e,) 


QA+E 1 =aAtE, — 


1€, Engi =En — 


60 © Numerical METHODS IN ENGINEERING AND SCIENCE 


fla)+e,f'(a)+5e.2f" (at . | 
i — = Feiss. “0 eee 
1 
n ( )+— 42 i Je 7 
=Z enf la) + 562 f"la _ €,2 f’(a) be f(a) =0) 


: fila)+e, f'(a)t-: 2. fla) 

This shows that the subsequent error at each step is proportional to the 
square of the previous error and as such the convergence is quadratic. Thus 
the Newton-Raphson method has second order convergence. 


EXAMPLE 2.30 


Find the positive root of xt — x = 10 correct to three decimal places, 
using the Newton-Raphson method. 


Solution: 

Let fix) =x4-—x-10 

so that f(1)=—10==ve, f(2)=16=—2-10=4=+ve. 
A root of f(x) = 0 lies between 1 and 2. 

Let us take x, = 2 

Also f(x) =4x3-1 


Newton-Raphson’s formula is 


f(x) 
f'(x,) 


Putting n = 0, the first approximation x, is given by 


ta) agi J 2) 


Xnty F%Xy ~ 


Xx) =Xy — — 
SFG) f'(2) 
=9-—_-__=2-* =1871 
4x2°-] 31 
Putting n = 1 in (i), the second approximation is 
x 1.871 
yy =x, —F6) 21.97, - F087) ) 
f'(x,) f'(.871) 
4 
~ 1871-8) eH) 10 
4(1.871)°—1 
=1.871- oe = 1.856 
5.199 
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Putting n = 2 in (ii), the third approximation is 


f (xs) _ 1.856)" — (1.856) — 10 


= 1.856 


Ng =Xy — 
o,f) 41856) —1 
= 1,956 — ol <1 956 
24.574 


Here x, = x,. Hence the desired root is 1.856 correct to three decimal 
places. 


EXAMPLE 2.31 


Find by Newton’s method, the real root of the equation 3x = cos x + 1, 
correct to four decimal places. 


Solution: 
Let fix) =3x =cosx=1 
f(0) =- 2=-ve, f(1) =3 — 0.5403 — 1 = 1.4597 = + ve. 
So a root of fix) = 0 lies between 0 and 1. It is nearer to 1. Let us take 
x, = 0.6. 
Also f’(x)=3+sinx 
.. Newton’s iteration formula gives 


7 = f (x,) =a 3x, — COs X,, -l 

ne file) ~*n 3+sinx,, 
_ x, sinx, +cosx, +1 ; 
7 3+sinx, 


Putting n = 0, the first approximation x, is given by 


_ _ Xp Sinxy +.cos xy +1 _ (0.6)sin (0.6) + cos(0.6) +1 


x 
: 3+ sin xy 3+sin (0.6) 
0.6 X 0.5729 + 0.82533 + 1 
3+0.5729 


Putting n = 1 in (i), the second approximation is 

_ x, sinx, +cosx, +1 _ 0.6071sin (0.6071) + cos (0.6071) +1 
3+sinx, 3+sin(0.6071) 

= 0.6071 X 0.57049 + 0.8213 + 1 

7 3+ 0.57049 


X 


= 0.6071 
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Here x, = x,. Hence the desired root is 0.6071 correct to four decimal 
places. 


EXAMPLE 2.32 


Using Newton’s iterative method, find the real root of x log,, x = 1.2 
correct to five decimal places. 


Solution: 

Let f(x) =x log, x - 1.2 

fll) =-12= ve, fl2) =2 log, 2 - 1.2 = 0.59794 = - ve 
and = f(3)=3 tog -O 3-1.2= 1.43814 —- 1.2 = 0.23136 = + ve. 
So a root of f(x) = 0 lies between 2 and 3. Let us take x, = 2. 
Also f'(x) =log,)x+ x log e = log) x + 0.43429 


. Newton’s iteration formula gives 


f(x,) — 0.43429x, +12 


fi(x,)  logl0x, + 0.43429 


Xnt1 Xn 7 


Putting n = 0, the first approximation is 


_ 0.43429Xxy +12 _ 0.43429x 2 +12 
* Togio Xp +0.43429 — log,) 2+0.43429 
_0,86858K12__, 
~ 0.30103 + 0.43429 


x 


Similarly putting n = 1, 2, 3, 4 in (i), we get 
0.43429 x 2.81 +1.2 
no Tog) 2.81 + 0.43429 
_ 0.43429 x 2.741 + 1.2 
Tog) 2.741 + 0.43429 
_ 0.43429 2.741 41.2 
Tog) 2.74064 + 0.43429 
_ 0.43429 x 2.74065 +1.2 
Tog yy 2.74065 + 0.43429 


Here x, =x,. Hence the required root is 2.74065 correct to five decimal 
places. 


= 2.741 


= 2.74064 


= 2.74065 


= 2.74065 
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2.13 Some Deductions From Newton-Raphson Formula 


We can derive the following useful results from the Newton’s iteration 
formula: 


(1) Iterative formula to find 1/N is x, |, =x,(2 — Nx,) 
(2) Iterative formula to find JN is X= 1 (x, + N/x,) 
2 
(3) Iterative formula to find 1/-V/N is x, -1 (x, + I/Nx_) 
Pe) 


+1 


Iterative formula to find 4/N is x 


ws 


( n+1 = : [(k ~ 1) x, sa Ni/x,**)] 


Proofs. (1) Letx=I/N or l&-N=0 
Taking f(x) = 1/ — N, we have f(x) = — x-2. 


Then Newton’s formula gives 


C, 1/x,—N 1 
Xntl = Xn = f(r) = Xn SL Fist Xn +N 2 
f' (x, ) TX ~ 2 Xn 
= Xn + Xn _ Nx,” = Xn (2 =: Nx, ) 
(2)Letx= JN or x2-N=0. 
Taking f(x) =x? — N, we have f ’(x) = 2x. 
Then Newton’s formula gives 
x x7—-N 1 
Xn FXy ~ fA ) =X af a =(x,N/x,) 
f%,) de, 8 
1 . 1 
(3) Let x = or x7- —=0 


Taking f(x) =x? — I/N, we have f ’(x) = 2x. 
Then Newton’s formula gives 


‘ De 
F Gd) ou, rites 


x =X =X d 
n+1 n 7 i ) n Ow c 
f(x, 25. 2 


(4) Letx = S/N orx' -N=0 
Taking f(x) =x* — N, we have f (x) = kx*7 
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Then Newton’s formula gives 


“ a ae x,'—-N_ 1 7 N 
ti = Xa fc.) lnk (k De dome = ale 


“n 


EXAMPLE 2.33 


Evaluate the following (correct to four decimal places) by Newton’s it- 
eration method: 


(i) 1/31 (ii) V5 (it) 1/14 (iv) 24 3 
(v) (30). 
Solution: 


(i) Taking N = 31, the above formula (1) becomes 
ep =X, (2- 31x,) 
Since an approximate value of 1/31 = 0.03, we take x, = 0.03. 
Then x, =x,(2— 3lx,) = 0.03(2 — 31 x 0.03) = 0.0321 

x, =x,(2— 3lx,) = 0.0321 (2 — 31 x 0.0321) = 0.032257 
x,(2 - 31x.) = 0.032257(2 — 31 x 0.032257) = 0.03226 


Since x, =x, upto four decimal places, we have 1/31 = 0.0323. 


x 


x 3 


(ii) Taking N = 5, the above formula (2), becomes *,4; = s(x, +5/ x, ). 
Since an approximate value of /5=2, = 2, we take x, = 2. 
Then x, = ov +5/x9) = 5(2 +5/2) = 2.25 
Xp = s(x +5/x,) = 2.2361 
X3 = s(vs +5/x,) = 2.2361 
Since x, =x, upto four decimal places, we have V5 = 2.2361. 


(iit) Taking N= 14, the above formula(3), becomes x,,,, = sl, +1/(14x, )] 


1 
Since an approximate value of 1/V14 = V/v16 = 708, we take 
x, = 0.25, 
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1 ap _ 
ie +(14x,) ‘] = 5 [0-2672618 + (14x 0,2672618) | ]=0.2672612 


<4 = 
Since x, = x, upto four decimal places, we take V//14 = 0.2673. 
(iv) Taking N = 24 and k = 3, the above formula (4) becomes 
1 2 
X41, =—| 2X, +24/X_~ 
ntl Al n Hl n ] 
Since an approximate value of (24)! = (27)'° =3, we take x, = 3. 
1 d 1 
Then X,= 5 (2X0 +24X,")= 3 (6 +24/9) = 2.88889 
1 1 
X,= rica +24/X,?)= q12 x 2.88889) + 24 / (2.88889)” |= 2.88451 
1 2 1 2 
X,= 5 (2X +24/X,")= 512 x 2.88451 + 24 / (2.88451)” ]= 2.8845 


Since X, = X, up to four decimal places, we take (24)'” = 2.8845. 
(v) Taking N = 30 and k = —5, the above formula (4) becomes 


1 . 
X= =z(6x, +30/X,°)= “(6 -30X,") 
Since an approximate value of (30)—'” = (32)—'” = 1/2, we take x, = 1/2 
Then X,=—(6- a0x,°)= —-(6 — 30/2°) = 0.506495 


x =. 0.50625 : 
X, =—1(6-30x,°) = = [6 — 30(0.50625)° | = 0.506495 


_ 0.506495 


X, =—2(6-30X,°) [6 — 30(0.506495)” | = 0.506496 


Since x, =x, up to four decimal places, we take (30)"’” = 0.5065. 
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Exercises 2.5 


1. Find by Newton-Raphson method, a root of the following equations cor- 
rect to three decimal places: 


(Gi) x8 -3x+1=0 (ii) x8 — 2x -5 =0 
(ii) 8 —5x +3 =0 (iv) 3x3 — 9x? + 8 = 0. 


2. Using Newton’s iterative method, find a root of the following equations 
correct to four decimal places: 


(i) x4 +.x° — 7x? —x +5 =0 which lies between 2 and 3. 
(ii) x° — 5x? +3 =0. 
3. Find the negative root of the equation «° — 21x + 3500 = 0 correct to 2 
decimal places by Newton’s method. 


4. Using Newton-Raphson method, find a root of the following equations 
correct to three decimal places: 


i)x?+4sinx=0 
(ii) x sinx + cosx =0 orxtanx+1=0 
iii) e* =x° + cos 25x which is near 4.5 


(iv) x log, x = 12.34, start with x, = 10. 


v) cosx=xe’ (vi) 10°+x-4=0. 
1 
+ 
x+2 x41 
late these roots correct to five decimal places. 


5. The equation 2e°% = has two roots greater than — 1. Calcu- 


6. The bacteria concentration in a reservoir varies as C = 4e-* +e", 


Using the Newton Raphson (N.R.) method, calculate the time required 
for the bacteria concentration to be 0.5. 


7. Use Newton’s method to find the smallest root of the equation e* sin x = 
1 to four decimal places. 


8. The current i in an electric circuit is given by i = 10e™ sin 2ztt where t is 
in seconds. Using Newton’s method, find the value of ¢ correct to three 
decimal places for i = 2 amp. 

9. Find the iterative formulae for finding VN,/N where Nis a real num- 
ber, using the Newton-Raphson formula. 
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Hence evaluate: 
(a) J10 
(b) ¥21 
(c) the cube-root of 17 to three decimal places. 
10. Develop an algorithm using the N.R. method, to find the fourth root of 
a positive number N and hence find 4/32 


11. Evaluate the following (correct to three decimal places) by using 
the Newton-Raphson method. 


(i) 1/18 (ii) W/J15 (iti) (28)—4. 
12. Obtain Newton-Raphson extended formula 
eae f (x9) ALF (0) P f"(x0) 
r 8 fi(ay) 2 {F(x )} 


for the root of the equation f(x) = 0. 


Hence find the root of the equation cos x = xe* correct to five decimal 
places. 


Solution: 


Expanding f(x) in the neighborhood of x, by Taylor's series; we have 


O= f (fe) = f (x0 +2- 20) = f (0) +(x- x0) f'(%0) to first approxi- 


mately. 


Hence the first approximation to the root is given by 
x, — x, =—flx,)/f (x) (i) 
Again by Taylor’s series to the second approximation, we get 
JR) =f) Hz fF ee +s (= )27",) 


Since x, is an approximation to the root, fix,) =0 
1%) Pe =5) 7 oO + 5 =a) 7 a0 
te f(x) 1J-f(%) ies ; 
or Xx, ~ Xo --fey 4 F'(x) f (x) [by (i)] 


whence follows the desired formula. [This is known as the Chebyshev 
formula of third order. | 
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2.14 Miuller’s Method 


1. This method is a generalization of the secant method as it doesn’t require 
the derivative of the function. It is an iterative method that requires 
three starting points. Here, y = f(x) is approximated by a second degree 
parabola passing through these three points (x,_,, y, _,), (x, _,, y, _,) and 

(xi, yi) in the vicinity of the root. Then a root of this quadratic is taken as 

the next approximation x, _, to the root of f(x) = 0. 


2. Letx,_,,x,_,,x, be three approximations to the root @ of the equation 
fix) =Oandy,_,,y,_,,y, be the corresponding values of f(x). 
Assuming the equation of the parabola through the points (x, _,, y,_,), 
(x,_, y, _,) and (x,, y,) to be 


fix 
0 ie 
FIGURE 2.9 
Sit Pas 
y =ax” bx +c, (1) 
Yj-2 = AX _-9 + bx _5 te 
we get Yj) = aX + bx _j +e (2) 
and y, = ax; + bx, +c 


Eliminating a, b, c from (1) and (2), we obtain 
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; x— Xx, xX, —X,_ X, — Xj_< 
We now define 1 = iy = ze 6, = = (4) 
Xj; 7 Xi-1 Xj) ~%X Xj 


Then (3) simplifies to 
= (yoA, + y;-10; + yi Jaa 4 Hi —2P - yj0t- +y;Qi+d) | 
7 0; }, 


U L 


+ Y; (5) 


From (4), we get x =x,+A(xi—x,_,) (6) 


Now to find a better approximation to the root, we need the unknown 
quantity 2. To determine A, we put y = 0 in (5) giving 


(y,_A,-y,_,9,+y,)4,V+uAto,y,=0 (7) 
Where My = Yj-2 A; — Yj, OF +, (A, + 0;) 
Dividing throughout by Aid? and solving for 1/A*, we get 
=, * fu? —4y,0,4,(y, -24, -y, -15, + ,) | 
7 2y;0; 


Since x is close to xi, A should be small in magnitude. Therefore the sign 
should be so chosen to make the numerator largest in magnitude. Then (6) 
gives a better approximation to the root. 


Obs. This method is iterative and converges for almost all ini- 
tial approximations quadratically. In case no better approxima- 


tions are known, we take, x,_,=—1,x,_,=0, and X,=1. 


NOTE 


EXAMPLE 2.34 


Apply Muller’s method to find the root of the equation cos x = xe* which 
lies between 0 and 1. 


Solution: 

Let y = cos x — xe* 

Taking the initial approximations as 
x, ,=-Lx,_,=0,%,=1 


We obtain y,_,=coslt+et.y ,=l,y,=cosl-e 


“As a direct solution of (7) usually leads to inaccurate results, we solve it for I/. 
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A=x—-1,4,=1,6,=2 
and Lt, = (cos 1 +e!) — 4+ 3(cos 1 —e). 
. From (7), we get two values of a7. (i) 


We choose the —ve sign so that the numerator in (i) is largest in magni- 
tude and obtain A = — 0.5585. 


. The next approximation to the root is given by (6) as 
X, =x, tA(x,-x,_,) = 1- 0.5585 = 0.4415, 


i+] 
Repeating the above process, we get 
x, ,=0.5125,x,,=0.5177,x,,,=0.5177 
Hence the root is 0.518 correct to three decimal places. 


Exercises 2.6 


Using Muller’s method, find a root of the following equations, correct 
to three decimal places: 


1.x°-2x-1=0 2.0°-x7-x-1=0. 
31° + 20° + 10x — 20 = 0 taking x, =0, x, = 1 and x, =2. 
4. logx =x —3 taking x, = 0.25, x, = 0.5 and x, = 1. 


2.15 Roots of Polynomials Equations 


The methods so far discussed for finding the roots of equations can 
also be applied to polynomials. These methods, however, do not work well 
when the polynomial equations contain multiple or complex roots. We now 
discuss methods for finding all the real and complex roots of polynomials. 
These methods are especially designed for polynomials and cannot be ap- 
plied to transcendental equations. We begin with Horner’s method which 
is the best for finding the approximate values of real roots of a numerical 
polynomial equation. 

Approximate Solution of Polynomial Equations—Horner’s 
Method 


This method consists in diminution of the roots of an equation by suc- 
cessive digits occurring in the roots. 
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If the root of an equation lies between a and a + 1, then the value of 
this root will be a.bcd......, where b, c, d...... are digits in its decimal part. To 
obtain these, we proceed as follows: 


(i) Diminish the roots of the given equation by a so that the root of the 

new equation is 0. bed...... 

(ii) Then multiply the roots of the transformed equation by 10 so that 
the root of the new equation is D. cd...... 

(iii) Now diminish the root by b and multiply the roots of the resulting 
equation by 10 so that the root is c.d...... 

(iv) Next diminish the root by c and so on. By continuing this process, 
the root may be evaluated to any desired degree of accuracy digit by 
digit. The method will be clear from the following example: 


EXAMPLE 2.35 
Find by Horner’s method, the positive root of the equation x° + x? 
+x — 100 = 0 correct to three decimal places. 
Solution: 
Step I. Let fix) =x? +x? +x—- 100 


By Descartes’ rule of signs, there is only one positive root. Also 
f(4) =- ve and f (5) = +ve, therefore, the root lies between 4 and 5. 


Step II. Diminish the roots of given equation by 4 so that the trans- 
formed equation is 
x° + 13x? +57x -16=0 (i) 
Its root lies between 0 and 1. (We draw a zig-zag line above the set of 
figures 13, 57,— 16 which are the coefficients of the terms in (i) as shown 
below.) Now multiply the roots of (i) by 10 for which attach one zero to 
the second term, two zeros to the third term, and three zeros to the fourth 
term. Then we get the equation 


f(x) =x? + 130x° + 5700x — 16000 = 0 (ii) 
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1 ih 1 —100 (4.264) 
4 20 84 
5 21 —16000 
4 36 11928 
9 5700 —4072000 
4 264 3788376 
130 5964 —28362400 
2 268 
132 623200 
_2 __8196 
631396 
8232 
63962800 
13780 
Its root lies between 0 and 10. 
Clearly f (2) =—ve, f,(3) = +ve. 
. The root of (ii) lies between 2 and 3, i.e,. first figure after the decimal 
is 2. 


Step III. Diminish the roots of f,(x) = 0 by 2 so that the next trans- 


formed equation is 


x3 + 136x?+ 6232x — 4072 = 0. 


Its root lies between 0 and 1. (We draw the second zig-zag line above 
the set of figures 136, 6232, — 4072). Multiply the roots of (iii) by 10, i.e., 
attach one zero to second term, two zeros to the third term, and three zeros 


to the fourth term. Then the new equation is 
72) =x° + 1360x? + 623200x — 4072000 = 0 


Its root lies between 0 and 10, which is nearly = 


Step IV. Diminish the roots of f,(x) = 0 by 6, so that the transformed 


equation is 


4072000 _ 
623200 
Hence the second figure after the decimal place is 6. 
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x3 + 1378x? + 639628x — 283624 = 0. 


Its root lies between 0 and 1. (We draw the third zig-zag line above the 
set of figures 1378, 639628, — 283624.) As before multiply its roots by 10, 
i.e., attach one zero to the second term, two zeros to the third term, and 
three zeros to the fourth term. Then the equation becomes 


f(x) =x? + 13780x? + 63962800x — 283624000 = 0 


Its root lies between 0 and 10, which is nearly = eso 


63962800 
the roots of f,(x) = 0 are to be diminished by 4, i.e., the third figure after 
the decimal place is 4. But there is no need to proceed further as the root is 
required correct to three decimal places only. 


Hence the root is 4.264. 


4. Thus 


Obs. 1. After two steps of diminishing, we apply the principle of trial 
divisor in which we divide the last coefficient by the last but one coefficient 
to get the next integer by which the roots are to be diminished. These last 
two coefficients should have opposite signs. 


Obs. 2. At any stage if the trial divisor suggests the next integer to be 
zero, then we should again multiply the roots by 10 and write zero in the 
decimal place of the root. 


EXAMPLE 2.36 


Find the cube root of 30 correct to three decimal places, using Horner’s 
method. 


Solution: 

Step I. Letx = 30 ice. fix) = -30=0 
Now (3) =—3 (-ve), f(4) = 34 (+ve) 
“. The root lies between 3 and 4. 


Step II. Diminish the roots of the given equation by 3 so that the trans- 
formed equation is 


x3 + Ox? + 27x -3 =0 (i) 
Its roots lies between 0 and 1. (We draw a zig-zag line above the set 


of numbers 9, 27, — 3 which are the coefficients of the terms in (i)). Now 
multiply the roots of (i) by 10 for which attach one zero to the second term, 
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two zeros to the third term, and three zeros to the fourth term. Then we 
get the equation 


fi) =x? + 90x? + 2700x — 3000 = 0 (ii) 
Its roots lies between 0 and 10. 
Clearly f,(1) =—ve, f,(2) =+ve 
.. The root of (ii) lies between 1 and 2, i.e., first figure after the decimal 
place is 1. 
Step III. Diminish the roots of f,(x) = 0 by 1, so that the next trans- 
formed equation is 
x° + 93x? + 2883x — 209 = 0. (iii) 
Its root lies between 0 and 1. (We draw a second zig-zag line above the 
set of figures 93, 2883, — 209). Multiply the roots of (iii) by 10, i.e., attach 


one zero to second term, two zeros to the third term, and three zeros to the 
fourth term. Then the new equation is 


f(x) =x? + 930x° + 288300x — 209000 = 0. 


Its root lies between 0 and 10, which is nearly = 209000/288300 = 
0.724 > Oand < 1. 


Hence second figure after the decimal place is 0. 


1 0 0 —30 (3.107 
3 9 27 
3 9 —30000 
3 18 2791 
6 2700 —209000000 
3 91 
90 2791 
il 92 
91 28830000 
i 
92 
J 
9300 


Step IV. Diminish the root of f,(x) = 0 by 0 and then multiply its roots 
by 10 so that 


f(x) = 2° + 9300x? + 28830000x — 209000000 = 0 
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Its root lies between 0 and 10, which is nearly 
= 209000000/28830000 = 7.2 > 7 and < 8. 


Thus the roots of f,(x) = 0 are to be diminished by 7, i.e., the third figure 
after the decimal is 7. 


Hence the required root is 3.107. 


Exercises 2.7 


1. Find by Horner’s method, the root (correct to three decimal places) of 
the equations (i) x° — 3x + 1 = 0 which lies between 1 and 2. (ii) x3+x«—-1 
= 0. (dit) 23 — 3x? + 2.5 =0 which lies between I and 2. 


2. Using Horner’s method, find the largest real root of x? — 4x +2 =0 
correct to three decimal places. 


3. Show that a root of the equation x* + x° — 4x” — 16 = 0 lies between 2 and 
3. Find its value correct up to two decimal places by Horner’s method. 


4. Find the negative root of the equation x* — 9x? + 18 = 0 correct to two 
decimal places by Horner’s method. 


5. Find the cube root of 25, correct to four decimal places, using Horner’s 
method 


2.16 Multiple Roots 


If @ is a root of f(x) = 0 of order m, then f(a) = 0, f (a) = 0,---, 
f”- (a) =0 and f” (a) #0. Such an equation can be written as f(x) = (x — a)” 
p(x) = 0. In other words, if @ is a root of f(x) = 0 repeated m times, then it is 
also a root of f’(x) = 0 repeated (m — 1) times, of f “(x) = 0 repeated (m — 2) 
times and so on. 

Multiple roots by Newton’s method. Let @ be a root of the polyno- 
mial equation f(x) = 0 which is repeated m times, If x,, x,, x,,--+,%, , ;, be its 
successive approximations then on the lines of Newton’s iterative method, 


fixe) 


we have Xn41 FX) 77 fix ) 
“Nn 


which is called the generalized Newton’s formula. It reduces to Newton- 
Raphson formula for m = 1. 
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Obs. 1. [f initial approximation x, is sufficiently close to the root 


NOTE a, then the expressions 
Ff (xo) f'(Xo) f Xq) 
y= xy —(m—1 Xp —(m—2 ou 
Xy =m ¥')° (m—1) Fy) ty — (n= 2) (xy) 


will have the same value. 


Obs. 2. Generalized Newton’s formula has a second order con- 
vergence for determining a multiple root. (see Example 2.38). 


EXAMPLE 2.37 


Find the double root of the equation x? — x? -x + 1=0. 


Solution: 
Let fix) =88-x?-x4+1 
So that f (x) =3x? — 2x - 1, f(x) = 6x - 2 
Starting with x, = 0.9, we have 
x, 2X0.019 
ty 2 P(r) 9.9 2%0019 _ 5 og 


f(x) —0.37 


and X) -(2-1) 


The closeness of these values implies that there is a double root near 
c=, 


.. Choosing x, = 1.01 for the next approximation, we get 


x, -2 FCs) _ 5 gy 2% 0.002 _ 1 oo 91 
f'(x) 0.0403 
1 -(2-t (1) _ 919-0408 _ 1 001 


fq) 4.06 
This shows that there is a double root at x = 1.0001 which is quite near 
the actual root x = 1. 


EXAMPLE 2.38 


Show that the generalized Newton’s formula x, , , = x, — 2f(x,)/f’(x,) 
gives a quadratic convergence when the equation f(x) = 0 has a pair of 
double roots in the neighborhood of x = x,. 
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Solution: 
Suppose x =a is a double root near x = x,. 
Then f(a) = 0, f(a) =0 (i) 
_2f (ate, ) 
f (a +e, ) 


Expanding f(@ + €) and f(a + €) in powers of €, and using (i), we get 


We have Eng = En 


En+1 =é— 


«| P@+te, f(a] 


=é&, = approx. 


© ft(a)+ 2 $a) 
pra) 1 f"@) 
pars gra 6" LO) 


p} 


1 
=—6E, 
6 


av 


which shows that € , ,< €,? and so the convergence is of second order. 


2.17 Complex Roots 


We know that the complex roots of an equation occur in conjugate 
pairs, i.e., if@ + if is a root of f(x) = 0, a — if is also its root. In other words, 
[x — (a + i8)] and [x — (a — if)] are factors of f(x) or (x — @ — iB) (x —@ + ip) = 
x? — 2x + a? + B? is a factor of f(x). This implies that we should try to isolate 
complex roots by finding the appropriate quadratic factors of the original 
polynomial. A method which is often used for finding such quadratic factors 
of polynomials is the Lin-Bairstow’s method. However Newton’s method 
can also be used to find the complex roots of a polynomial equation which 
we illustrate below: 


EXAMPLE 2.39 


Solve x* — 5x° + 20x* — 40x + 60 = 0, by Newton’s method given that all 
the roots of the given equation are complex. 
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Solution: 

Let fix) =x* — 5x9 + 20x? — 40x + 60 =0 (i) 
so that f(x) = 4x? — 15x? + 40x — 40 

.. Newton-Raphson method gives 


f(x, ) i," — 5x,” + 20x, = 40x, a 60 
Xn = Xn oa , = Xn _ : 
“ F(a) 4x,> —15x,,7 +40x, — 40 
_ 3x,'—10x,° + 20x,” — 60 


4x,° — 15x,” + 40x, — 40 

Putting n = 0 and taking x, = 2(1 + i) by trial, we get 
— _ 8(2+2i)' —10(2 + 2i)* + 20(2 + 21)” — 60 
"1 "4(2-4 21)? —15(2+ 24)” +40(2 +21) — 40 

Similarly 


=1.92(1 +i) 


3(1.92 + 1.921) —10(1.92 +1.92i)° + 20(1.92 + 1.92%) — 60 
X= 
> 4(1.92 +1.92i)° —15(1.92 + 1.92%)" + 40(1.92 + 1.92%) — 40 
= 1.915+1.908i 
Since complex roots occur in conjugate pairs so the roots of (i) are 1.915 
+1.908i up to three places of decimals. Assuming that the other pair of roots 
of (i) is a if, we have 
Sum of the roots = (a + i8) + (a — iB) + (1.915 + 1.9081) + (1.915 - 
1.908i) =5 
i.é., 2a + 3.83 =5 or a = 0.585. 
Also the product of roots = (@? + 8?) {(1.915)? + (1.908)?} = 60 


which gives 8 = 2.805. Hence the other two roots are 0.585£2.805i. 


2.18 Lin-Bairstow’s Method 


This method is often used for finding the complex roots of a polynomial 
equation with real coefficients, such as 


fix) =a ta x tax +e +a xt+a =0. (1) 
Since complex roots occur in pairs as @+ i, each pair corresponds to 
a quadratic factor 
{x —(@ +i P)} {x -(a-iB)} =x? -2ax+a?+ B? 


SOLUTION OF ALGEBRAIC AND TRANSCENDENTAL EQuaTIONs © 79 


which is of the form x? + px + q. 

If we divide f(x) by x°+ px + q, we obtain the quotient Q, ,=x"* +b, x" 
++--+b_ and the remainder Rn = Rx + S. 

Thus f(x) = "+ px +9) A 4b 9 bee tb) eRe S, (2) 


If x° + px + q divides f(x) completely, the remainder Rx + S = 0, i.e., 
R=0, § =0. Obviously R and S both depend upon p and q. So our problem 
is to find p and q such that 


R (p, q) =0, S (p, q) = 0. (3) 

Let p + Ap, q + Aq be the actual values of p and q which satisfy (3). 
Then 

R (p + Ap, q + Aq) = 0, S (p + Ap, q + Aq) = 0. (4) 


To find the corrections A p, A q, we expand these by Taylor’s series and 
neglect second and higher order terms. 


Roast ae SG 
as as 

S +—Ap +—Agq =0 

(p.q) ce ea 


We solve these simultaneous equations for Ap and Aq and then the 
procedure is repeated with the corrected values for p and g. Now to com- 
pute the coefficients bi, R, and S$, we compare the coefficients of like pow- 
ers of x in (2) giving 


b,=a,-p 

b, =a, pb, ~q 

b,= a pb, qb. (6) 
R as = pb, qb,_s s a a qb, 


We now introduce b _, and bn and define 
b=a,-pb,,-qb,_,i=1,2,--0 (7) 

where b,=1,b_,=0=b., 

Comparing the last two equations with those of (6), we get 


b 1 = a4 ~ P a = q Dg 7 R 


n- ‘2 
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b, = a, = P by ~ q Dig = S = P Dey 
giving R=b,_,andS=b +pb_, (8) 
Substituting these values in (5), we get 


b,-. + Oy Ap + Oy Aq =0 
op Op 


db, 
op 


+b | Ap + | ws + po. Jou =0 
q 


b,, + pb, + oy + P 
op oq 


Multiplying the first of these equations by p and subtracting from the 
second, we get 
db, Ap db, Aq +b,, ; =0 
dp aq 


b b " 
2 a4 bs }p pap: =0 
dp dq 


Now differentiating (7) w.r.t. p and q partially and noting that all ai’s are 
constants and all bi’s are functions of p and q, we have 


obi _ Ob,_, = Ob;_» Ob, iia db_, 
ap “ dp dp ° dp ap (10) 
abi ab;_, Obi» OD, ob_, 
—=—b,» ~q ; == 
aq aq dq 0g aq 
Also from (6), we get 
dbo “He ab, ai = db, ” Sp ey, 
dp dq op aq aq 
Ws = 4, —pM=-» + pb, 
dp dp 
ab, abs ab 
—=-b, - =—p—=-—b, + pb 
aq 1 P aq P F 1 P 0) 


ab, ab, ab, dbs 
— = — anda —= 
dq op dq Op 


By mathematical induction, we shall prove that AD jx1 = 6b; , for alli 
dq Op 


Thus we have 
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Let the result be true for i =r, then Dp = db, (1a) 
oq (Og 
But using (10) 
db.49 = —b, Oby41 ag 
dq dq aq 
Ob,4 ab db,_, OD, ob 
ia I SY onl RO r 
and ra =p rs q > rp aq q aq [by (11)] 
ot ob +2 ob +] . s me — 
This shows that —“2 =—! i.e., the result is true fori =r+ 1. But 


it is for i = 1 and should this be i = 2. Hence by induction, it is true for all 
values of i. ; ; 

Now writing = -¢,_,,i=0,1,2,---,n-1 (12) 
dq Op 
the equations in (10) can be expressed as 

C..> Bs ~P&.9 74 ©, 3 C9 = bes ~P e357 7&4 
These can be compressed into a single equation 
C,= b, ~P 47 7-5 

with c,=0,c_,=0,i=1, 2...., (n—-1) (13) 
Thus c, is computed from b, in exactly the same way as b, from ai in (7). 


Differentiating the relations in (8) and using (12), we get 


aR ob,_, aR ab,, 
~ ™~ Yn—2? ‘+ =~Cn-3 
op Op oq 9g 
aS ob dbn-1 
and Pa 7 + Dis + P - = ~Cp-1 PCn-2 + by 
op op op 
aS dbn db, 


dp 7 dq dq 
Substituting these in (5), we get 
pes = C.-2 Ap Ce 


and b tpn tie, 


Aq =0 
a PC, -2 - b,_.) Ap + ? Ch 9 ~ pc,,_s) Aq = 0 


Cy_oAp + Cy_3Aq = Dy 
(ena ~ 5) Ap + C, 9Aq = b, 


n-3 


or 


(14) 


82 © NumerICAL METHODS IN ENGINEERING AND SCIENCE 


After finding the values of b,’s and c,’s from (7) and (13) and putting in 
(14), we obtain the approximate values of Ap and Aq, say Ap, and Aq,. If 
Py Jy are the initial approximations then their improved values are p, =p, + 
AP 9, = Jo+ Ado: Now taking p, and q, as the initial values and repeating 
the process, we can get better values of p and q. 


Obs. The values of bi’s and ci’s are found by the following 


NOTE (synthetic division) scheme: 
a,(= 1) a, a, or ae ay a,, 
— pb, — pb, — pb, wa = pb. =p,» —pb,_, ae 
S qh, ~ qb, a qb, = qb. a qb,» Zz q 
b= 1) b, b, b, bs bi b, 
Po pe, — pe, ~e — Pes — Pe,» ~P 
— gC, — qc,» — Ge, 4 — qe, _5 —q 
c,(= 1) C, C, Cc Cc Cc 


EXAMPLE 2.40 


Solve x* — 5x° + 20x? — 40x + 60 = 0, given that all the roots of f(x) = 0 are 
complex, by using the Lin-Bairstow method 


Solution: 


Starting with the values p, = — 4, g, = 8, we have 


i 5 20 —40 60 
E 4 -4 32 : 
a _ 28 8 —64 --& 
i -] 8 O(= b,) —4(= b) 
4 12 48 4 
8 ~24 “8 
1 3(=c,,) [12(=c,,) 24(=c,_,) 


c,,—b,.,=24-0=24 
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Corrections Ap, and Aq, are given by 
c,,Ap,te,,Aq,=b,,, i.e. 12 Ap, +3 Aq,=0 
(c_,—5,,) Ap, t+c¢,., Aq, =, ie., 24 Ap, +12 Aq, =-4 
Solving, we get Ap, = 0.1667, Ag, =— 0.6667 
; P, =P, + Ap, = — 3.8333 
1 =o + AQy = 7.333 


Now repeating the same process, i.e., dividing f(x) by x? — 3.8333x + 
7.3333, we get 


1 —5 20 —40 60 
3.8333 —4.4723 31.4116 —0.125 3.8333 
-7.3333 8.5558 —60.092 -7.3333 
1 —1.1667 8.1944 —0.0326 —0.217 
0,4) (=b,) 
3.8333 10.2219 42.4845 3.8333 
-7.3333 —19.555 -7.3333 


1  2.6666(=c, ,) 11.083(=c, ,) 22.8969(=c,_,) 
b,_, = 22.8969 + 0.0326 = 22.9295 


Cc n-1 


n-l 
Corrections Ap, and Aq, are given by 
11.083 Ap, + 2.6666 Aq, =— 0.0326 
22.9295 Ap, + 11.083 Aq, =— 0.217 
Solving, we get Ap, = 0.0033 and Aq, = — 0.0269 
P,=P, + Ap, =— 3.83, q,= 4, + Ag, = 7.3064. 
So one of the quadratic factors of f(x) is 
x? — 3.83 « + 7.3064. (i) 
Ifa +i be its roots, then 2a = 3.83, a? + B° = 7.3064 giving a = 1.9149 
and 6 = 1.9077. 
Hence a pair of roots is 1.9149 + 1.9077 i 
To find the remaining two roots of f(x) = 0, we divide f(x) by (i) as fol- 
lows [by Section 2.5 (3)]: 
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1 —5 20 —40 60 
3.83 4.4811 31.4539 3.83 
-7.3064 8.5485 —60.0038 -7.3064 
1 Se les 8.2125 0.0024 —0.0038 
~ 0 x0 


. The other quadratic factor is x? — 1.17x + 8.2125. 


If y +i 6 be its roots, then 2 6 = 1.17, y? + 6? = 8.2125 giving y = 0.585 
and 6 = 2.8054. 


Hence the other pair of roots is 0.585 + 2.8054 i. 


2.19 Graeffe’s Root Squaring Method 


This method has an advantage over the other methods in that it does 
not require any prior information about the roots. But it is applicable to 
polynomial equations only and is capable of giving all the roots. Consider 
the polynomial equation 


he ee he ee =) (1) 
Separating the even and odd powers of x and squaring, we get 
(x" 4 a, qe a, yr-4 +"° *)2 = (a, grt a a, xr3 ees 2 


Putting x* = y and simplifying, the new equation becomes 


th, YO + .cth 9 +0, =0 (2) 
where b, =—a,” + 2a, 
by = ds" — 2a,a3 + 2a, (3) 


b, =(-1)"a,” 
Ifa,,a,, ...@, be the roots of (1) then the roots of (2) area,?, a’, .... @,”. 
After m squarings, let the new transformed equation be 
zt+e,=0 (4) 


whose roots y,, Y,, --., ym are such that yi = ai, i= 1, 2,... n. 


ie Sa re 
n-1 


Assuming that |@,|>|a@,|>...>|an 
| where >> stands for “much greater than.” 


,then|y,|>>|y,| >>... >>|y¥, 
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Thus | ¥2 | =/2., lyn| _ Yn are negligible as compared to unity. 
lv, | "1 "yy 1 | Yami (5) 


Also y, being an even power of a, is always positive. 


*. From (4), we have 


Y2 gray 
VY, =-c, te. c, =y,}1+—= +-| 
> 1 1 ion ( vi, a 


DS nve =—e 1€. Cy = yire{4224--| 


Vio, =(-1)"c, ie. c, =(FD)" 17 9°"Y, 


Hence by (5), we get c, ®— 1, €, © V1 Vo C3 ® V1 Vo Vo 
ie., v=, Me edey Va cJc, poy, = =¢fe.. 1 
Now since y, =a", .a,=(y)'?"=|c/e,, | (6) 


Thus we can determine @,, @,, ... an, the roots of (1). 


Obs. 1. Double root. If the magnitude of ci is half the square of 
NOTE the magnitude of the corresponding coefficient in the previous 
equation after a few squarings, then it shows that ai is a double 
root of (1). We find this double root as follows: 


Ch Ch41 
Mee and Py 
Ch} C 
a Dos Cha 2n _ Di Chat 
a Ao od 6 od 1e., OG =Y¥e =| (7) 
Ck-1 Ck-1 


This gives the magnitude of the double root and substituting in (1), we 
can find its sign. 
Obs. 2. Complex roots. Ifa and a_,, form a complex pair p, 
e**,, then the coefficients of x"" in successive squarings would 
fluctuate both in magnitude and sign by an amount 2p,"" cos 


mo. 
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For m sufficiently large p, and @, can be determined by 


9 (2m) 


pre 


Cray 7 


C, 
‘cosm@r = (8) 
Cy-y 


Cry 


,2p,' 


If (1) has only one pair of complex roots say: p, e*# = € + in, then we 
can find all the real roots. Thereafter € is given by 


a,+a,+--+a_,+2+a_,+--+a,=-4, (9) 
and 7 is given by p, = +n? or n= (pr? —é°) 


EXAMPLE 2.41 


Find all roots of the equation «* — 2x? — 5x + 6 = 0 by Graeffe’s method, 
squaring three times 

Solution: 

Let flix) =<° — 2? —5e +6=0 (i) 

+ - - + 

By Descartes rule of signs, there being two changes of sign, (i) has two 
positive roots. 

Also fi-x) =- 23 — 2x? + 5x + 6 

- -+ + 
i.e., one change in sign, there is one negative root. 
Rewriting (i) as «° — 5x = 2x? — 6 and squaring, 


we get y (y — 5)? = (2y — 6)? where y =x? 


or y (y? + 49) = 14y7+ 36 ... (ii) 
Squaring again and putting y* =z, we obtain z (z + 49)? = (14. z + 36)” 
or 2(z? + 1393) = 98 22 + 1296 (iti) 


Squaring once again and putting Z=uU, 


we get u (u + 1393)? = (98 u + 1296)? 


or u>— 6818 uw? + 1686433 u — 1679616 =0 (iv) 
If the roots of (iv) are y,, y,, 73, then y, =—c, = 6818, 
yo =-2= TO8O188 =~ 947 BEbi: 
c, 6818 
3 167961 
a a EE aig 


c2 1686433 
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Ifa,, @,, a, be the roots of (i), then 
| c, |= (y,)!8 = 3.014443 ~3 
| o, | = (y,)!8 = 1.991495 ~ 2 
| a, | = (y,)!8 = 0.999499 ~ 1 


The sign of a root is found by substituting the root in f(x) = 0. We find 
f{8) = 0, f(— 2) =0, fil) =0. 


Hence the roots are 3, — 2, 1. 


EXAMPLE 2.42 
Apply Graeffe’s method to find all the roots of the equation «* — 3x + 1 
=0. 
Solution: 
We have fix) =x*-3x4+1=0 (i) 
+- + 
“. There being two changes in sign, (i) has two positive real roots and 
no negative real root. 
Thus the remaining two roots are complex. 
Rewriting (i) as x* + 1 = 3x, and squaring, we get (y? + 1)? = 9y where 
y=x. 
Squaring again and putting y? = z, we obtain 
(+ 1)*=8lz or, 24+ 42° + 622-772 +1=0 (ii) 
or 2'+ 6274+ 1 =—2(42?-77) 
Squaring once again and putting z° = u, we get (u* + 6u + 1)? = u(4u - 
- ut — 4u? + 654u? — 5917u +1=0 (iti) 
Ifa,, @,, a,, @, be the roots of (i), then the roots of (iii) are a,°, a,°, a,°, 
a. Thus (iii) gives 


a =4 ie.,a, = 1.1892 
oe = ie = 163.5 i.c.,0y = 1.891 

i= a =9.0474 — i.e.,a@3 = 1.3169 
i = ao =0.00017  i.e.,@, = 0.3379 
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From (ii) and (iii), we observe that the magnitudes of the coefficients c, 
and c, have become constant. This indicates that a, and a, are the real roots 
whereas a, and @, are a pair of complex roots. 


.. The real roots @, = 1.1892 and a, = 0.3379. 
Now let us find the complex roots p,°*” = + in. 
From (iii), its magnitude is given by 

Pacts = eH. a p,! = 5917 


—— = 1479.25 
Co-} 4 


Where p,= 1.5781. 

Also from (i), @, + 26 +a,=0 

g (4, +4,)=—0.7636 and y= (p.? —£?) =1.381 
Hence the complex roots are — 0.7636 + 1.381 i. 


This gives E=- 


Exercises 2.8 


1. Find a double root of the equation x? — 5x? + 8x — 4 = 0 which is near 1.8. 


2. Find the multiplicity and the multiple root of the equation «*— 11x* + 
36x? — 16x — 64 = 0 which is near 3.9. 


3. Apply theNewton’s method to find a pair of complex roots of the equa- 
tion x4 +2° + 5x? + 4x + 4 =0 starting with x, =i. 


4. Apply Lin-Bairstow method to find a quadratic factor of the equation x* 
+ 5x? + 3x? — 5x -— 9 close tox? + 3x —5. 


5. Find the roots of the equation x4 + 9x° + 36x? + 51x + 27 = 0 to three 
decimal places using the Bairstow iterative method. 


6. Find the quadratic factors of the equation «* — 8x° + 39x? — 62x +50 = 
0 by using the Lin-Bairstow method (up to the third iteration) starting 
with p, = 0, q, = 9. 


. Solve x? — 8x? + 17x — 10 = 0 by Graeffe’s method. 


N 


8. Apply Graeffe’s method to find all the roots of the equation x° — 6x? + 
llx-6=0. 


10. 


11. 
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. Solve the equation x° — 5x? — 17x + 20 = 0 by Graeffe’s method, squaring 


three times. 


Find all the roots of the equation x°— 4x? + 5x — 2 = 0 by Graeffe’s 
method, squaring thrice. 


Determine all roots of the equation x° — 9x” + 18x — 6 = 0 by Graeffe’s 
method. 


2.20 Comparison of Iterative Methods 


1 


. Convergence in the case of the bisection method is slow but steady. It is, 


however, the simplest method and it never fails. 


. The method of false position is slow and it is first order convergent. Con- 


vergence however, is guaranteed. Most often, it is found superior to the 
bisection method. 


. The secant method is not guaranteed to converge. But its order of 


convergence being 1.62, it converges faster than the method of false 
position. This method is considered most economical giving reasonably 
rapid convergence at a low cost. 


. Of all the above methods, Newton-Raphson method has the fastest rate 


of convergence. The method is quite sensitive to the starting value. Also 
it may diverge if f(x) is near zero during the iterative cycle. 


. For locating the complex roots, Newton’s method can be used. Muller's 


method is also effective for finding complex roots. 


. If all the roots of the given equation are required then the Lin-Bairstow 


method is recommended. After a quadratic factor has been found, then 
the Lin-Bairstow method must be applied on the reduced polynomial. 
If the location of some roots is known, first find these roots to a desired 
accuracy and then apply the Lin-Bairstow method on the reduced 
polynomial. 


. If the roots of the given polynomial are real and distinct then Graeffe’s 


root squaring method is quite useful. 
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2.21 


Objective Type of Questions 


Exercises 2.9 


na & W N 


11 


12. 


13. 


Select the correct answer or fill up the blanks in the following questions: 


. The order of convergence in the Newton-Raphson method is 


(a) (b)3 (c)O ~~ (d) none. 


. The Newton-Raphson algorithm for finding the cube root of N is........... 
. The bisection method for finding the roots of an equation f(x) = 0 is.......... 
. In theRegula-falsi method, the first approximation is given by............. 


. If f(x) = 0 is an algebraic equation, the Newton-Raphson method is 


given by xn,, =xn —f («n)/? 
(a) y(t) (b) f “a, _;) (c) f’(x,) (a) Fy” 0x) 


n 


. In the Regula-falsi method of finding the real root of an equation, the 


curve AB is replaced by...... 


. Newton’s iterative formula to find the value of JN is........0....- 


. A root of x° — x +4 =0 obtained using the bisection method correct to 


two places, is........ . 


. Newton-Raphson formula converges when............ : 


. In the case of bisection method, the convergence is 


(a) linear (b) quadratic (c) very slow. 


. Out of the method of false position and the Newton-Raphson method, 


the rate of convergence is faster for............ . 


Using Newton’s method, the root of x? = 5x — 3 between 0 and 1 correct 
to two decimal places, is........ . 
The Newton-Raphson method fails when 

(a) f (x) is negative (b) f (x) is too large 

(c) f (x) is zero (d) Never fails. 


14. 


15. 


16. 


17. 


18. 
19. 
20. 
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The condition for the convergence of the iteration method for solving 


t= Oe) 19.0020 


While finding a root of an equation by the Regula-falsi method, the 
number of iterations can be reduced......... . 


Newton’s method is useful when the graph of the function while cross- 
ing the x-axis is nearly vertical. (True or False) 


The difference between a Transcendental equation and polynomial 
equation is......... ; 


The interval in which a real root of the equation x° — 2x — 5 = 0 lies is....... : 
The iterative formula for finding the reciprocal of N is x, , | =......... : 


While finding the root of an equation by the method of false position, 
the number of iterations can be reduced...... . 


CHAPTER 


SOLUTION OF SIMULTANEOUS 
ALGEBRAIC EQUATIONS 


Chapter Objectives 


Introduction to determinants 
Introduction to matrices 
Solution of linear simultaneous equations 


Direct methods of solution: Cramer’s rule, Matrix inversion 
method, Gauss elimination method, Gauss-Jordan method, 
Factorization method 


Iterative methods of solution: Jacobi’s method, Gauss-Seidal 
method, Relaxation method 


Ill-conditioned equations 
Comparison of various methods 


Solution of non-linear simultaneous equations—Newton-Raphson 
method 


Objective type of questions 


3.1. Introduction t to Determinants 


1. Definition. The expression is called a determinant of 


aq, Bj 
a, Dy 
the second order and stands for “a,b, — a,b,. It contains four num- 


bers a,, b,, a,, b, (called elements) which are arranged along two 
horizontal lines (called rows) and two vertical lines (called columns). 
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a b oC 
Similarly dy Dy (i) 
a 


is called a determinant of the third order. It consists of nine elements which 
are arranged in three rows and three columns. 


In general, a determinant of the nth order is of the form 


q\ (ap) a3 see eeeee Ay 
9) Ag. 93, se eeeeee Ayn, 
Any Eng Ay gerrereere Qin 


which is a block of n? elements in the form of a square along n rows and n 
columns. The ae through the left- hand top corner which contains the 
elements @,,, 4,5, @33, «++, d,,, is called the leading diagonal. 


Expansion of a ‘peaunade The cofactor of an element in a determi- 
nant is the determinant obtained by deleting the row and the column which 
intersect at that element, with the proper sign. The sign of an element in 
the ith row and jth column is (—1)'’. The cofactor of an element is usually 
denoted by the corresponding capital letter. 


For instance, the cofactor of b, in (i) is Bs =(- a0 


dg Co 


A determinant can be expanded in terms of any row or column as 


follows: 


Multiply each element of the row (or column) in terms of which we 
intend expanding the determinant, by its cofactor and then add up all these 
products. 


. Expanding (i) by R,(i.e. 1st row), 
A=a,A, +b,B, +¢,C, 

bs Co bs 

b, bs 


= a, (bycx — bycy) — by — 43Cy) + ¢, (yb, — aby) 


‘rel, 
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Similarly expanding by C, (i.e. 2nd column), 
A=bD,B, +b,B, + b;B, 


a Cc 
+53) 7 


Cy 


= by (axC3 — d3Cy) — bg (aye — d3C,) — bs (a,Cg — agC) 


EXAMPLE 3.1 
0 1 2 8 
Co a 0 
Find the value of A= bo Gesde 4 
3.0 1 2 


Solution: 


Since there are two zeros in the second row, therefore, expanding by 
R,, we get 


1 2 3 0 1 3 
A=-|3 0 1)/+0-3/)2 3 1/+0 
0 1 2 3.0 2 


(Expand By C,) (Expand by R,) 
=-—[1(0x2-1x1)-3(2*2-1x3)+0] 
—3(0-(2X2-3x1)+3(2x0-3xX3)] 
=—(-—1-—3)-—3(—1- 27) =44+84=88. 
Basic properties. The following properties enable us to simplify and 
evaluate a given determinant without expanding it: 
I. A determinant remains unaltered by changing its rows into col- 
umns and columns into rows. 
II. If two parallel lines of a determinant are interchanged, the deter- 
minant retains its numerical value but changes in sign. 
Il. A determinant vanishes if two of its parallel lines are identical. 
IV. If each element of a line is multiplied by the same factor, the 
whole determinant is multiplied by that factor. 
V. Ifeach element of a line consists of m terms, the determinant can 
be expressed as the sum of m determinants. 
VI. If to each element of a line there can be added equi-multiples 


of the corresponding elements of one or more parallel lines, the 
determinant remains unaltered. 
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a, + ph, — qc, 

For instance |a, + pb, — qcy 

a3 + pbs — qc3 

a b b, 

=a, by cg) t+p|be 

a, bz ¢3 b; 
=A+0+0=A 


AND SCIENCE 


be 
by Co 
b3 cs 
bc c, by 
by C3|—q\ey bs 
b; C3 cs bs 


Rule for multiplication of determinants: 


aq b cl} | m ny 
dy by Co|X|l, mg Ng 
ad; bs cs3| |lz m3 ng 
a,l, +bym, +e,n, 
=la,l, + bmg +cN5 


al, +byms3 +¢Ns 


gl, Pbgny + Cony 
gly + bymg + CyNo 


dgl, +bymz +CN3 


[From (iv)] 


a3l, +b,m, +¢3n, 
dsl, +b3mg +C4No 


djl, +b3m3 +C4N3 


ive., the product of two determinants of the same order is itself a deter- 


minant of that order. 


EXAMPLE 3.2. 


aad a-l 
If lb b 
2 


i a oe | 


Solution: 


b® —1|=0in which a, b, c are different, show that abc = 1. 


As each term of C,in the given determinant consists of two terms, we 
express it as a sum of two determinants. 


aaa-l\ la @ 
b b? b®?-1l=\b Bb? 


3 2 
c c cri je c 


bo 


2 


aa 


1 
=abc\b b? b°|-\b b? 1 
1 


a| ja a@ 1 
b*}+|b b? -1 
ce] le ce -1 


a2) la a 
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[Taking common a, b,c from R,, R,, R, respectively of the first determi- 
nant and — 1 from C, of the second determinant] 


2 2 
laa laa 


=abcll b bi-ll b BD? 
lec}! lec @ 
[Passing C, over C, and C, in the second determinant] 


2 
laa 


1 b b’\(abe-1)=0 


2 
L ¢ Cc 


2 
laa 


Hence abc = 1, since |} } b?2)/%0 asa, b,c are all different. 


2 
l coc 


EXAMPLE 3.3 
x+2 2xv4+3 38xt4 
Solve the equation 2x+3 3x+4 4x+5 /=0 
38x+5 5x+8 10x+17 
Solution: 
Operating R,— (R,+ R,), we get 
x+2 2xt+3 38xt+4 
Qn+3 3x+4 4x+5/=0 (Operate R,—R, and R,+ R,) 


0 1 3x +8 
x+2 2x+4 6x4+12 
or x+tl <xtl x+1)=0 
) 1 3x +8 
1 2 6 
or x+1)(x+2)]/1 1 1 |=0 


O 1 3x+8 
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To bring one more zero in C p operate R, — R,. 


0 1 5 
(x+1)(x+2)]/1 1 1 /=0 
0 1 3x+8 


Now expand by C,. 
—(x + L(x + 2)(8x + 8-5) =O or— 3(x + I(x + 2)(x +1) =0. 
Thusx =—1,-1,-2. 


EXAMPLE 3.4 
lt+a 1 1 1 
1 l+b 1 1 ltd. 
Prove that ; i ane “a = abe Serr 
1 1 1 l+d 
Solution: 


Let A be the given determinant. 


Taking a, b, c, d common from R,, R,, R,, R, respectively, we get 


a) +1 a a’ ar 
Asabed hb} bt41 b} b™} 

= abc 
e ce cl +l1 co? 


d"' d' d' d'+l1 
[Operate R, + (R,+ R,+ R,) and take out the common factor from R, | 
1 1 1 1 
b' bl+1 bt hb 


=abed(l+a +b +c'+d")| _, - = “4 
Cc Cc c +1 Cc 


a” <¢@" dt d+ 
[Operate C,-C,,C,-C,, C,-C,] 


1 O 0 
-1 
11 £1 =#«421\(0 1 00 
= abcd| 1+—+—+-—+— 
( eet sl og 
a’ 0-6 I 
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1 11 1 
= abcd|1+—+—+-—+— 
a bed 


EXAMPLE 3.5 
a+a? abt+cA ca-—ba) |, ¢ -b 
Evaluate |ab—cd b? +4? be+ad)x|-c A a 
catba be-ad 2+)? b -a kh 
Solution: 


By the rule of multiplication of determinants, the resulting determinant 


dy dy dy 
A=\dx, doy dys 
dx, ds. d33 


where d,, =(@ +47) + (ab + cA)jc + (ca—bA)(-b) =A (a +b? +? +2?) 
d,,=(a*+4°)(-c)+(ab+cAa)a + (ca-bd)ja =0,d,,=0, 
d,,=0,d,,=A (a+b? +0? +A’), d,,=9. 
d,,=0,d,,=0,d,,=A (a? +b? +c? +2’). 


Hence, 
Ma? +b? +c? +27) 0 0 
A= 0 Ma? +b? +c? +4") 0 
0 0 Ma? +b? +c? +4’) 


=P (a+b +0? +22). 


Exercises 3.1 


x x 14%? 


1.Ifly y? 1+y°|=0,then prove, without expansion, that xyz =— 1 where 
y Y Yy P p 


ze 14+23 
x, y, 2 are unequal. 
Prove the following results: (2 and 3) 
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2. lat+b a b 


a atc c |=4abc 
b Cc b+c 
45 6x 
5 6 7 yl, 
3.. > is a perfect square. 
x y z 0 
laa a+tbced 
4.|1 b b? b> +cda|vanishes. 
lc c c+dab 
1 c d? d+abc 


x+tl 2x4+1 3x4+1 
5. Solve the equation | 2x 4x+3 6x+3/=0. 
4x+]1 6x+4 8x+4 


6. Find the value of the determinant (M) if M = 3A?+ AB + B? 


2 1 1 5 0 -l 
where A=|1 2 1|,B=|-1 0 1 
0 -l 0 0 2 3 


without evaluating A and B independently. 


3.2 Introduction to Matrices 


Definition. A system of mn numbers arranged in a rectangular array of m 
rows and n columns is called an m x n matrix. Such a matrix is denoted by 


Gy, Ag" Ay, 


Gni 4n2°**Enn 


Special matrices 


1. Row and column matrices. A matrix having a single row is called a row 
matrix while a matrix having a single column is called a column matrix. 
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2. Square matrix. A matrix having n rows and n columns is called a square 
matrix. A square matrix is said to be singular if its determinant is zero 
otherwise it is called non-singular. 

The elements a, in a square matrix form the leading diagonal and their 
sum Xa, is called the trace of the matrix. 


3. Unit matrix. A diagonal matrix of order n which has unity for all its di- 
agonal elements is called a unit matrix of order n and is denoted by I, 


4. Null matrix. Lf all the elements of a matrix are zero, it is called a null 
matrix. 


5. Symmetric and skew-symmetric matrices. A square matrix [a,] is said to 
be a when a,=4, for alli andj. 
Ifa, =—a, for alli sad j so that all the leading diagonal elements are zero, 
then the matrix is called skew-symmetric. Examples of symmetric and 
skew-symmetric matrices are respectively 


ah g 0 h —g 


5 fo) 


h b filandj-h O- f 
a g -f 0 


6. Triangular matrix. A square matrix all of whose elements below the 
leading diagonal are zero is called an upper triangular matrix. A square 
matrix all of whose elements above the leading diagonal are zero is 
called a lower triangular matrix. 


Operations on matrices 


1. Equality of matrices. Two matrices A and B are said to be equal if and 
only if (i) they are of the same order, 


and (ii) each element of A is equal to the corresponding element of B. 


2. Addition and subtraction of matrices. If A and B are two matrices of the 
same order, then their sum A + B is defined as the matrix each element 
of which is the sum of the corresponding elements of A and B. 


Similarly A — B is defined as the matrix whose elements are obtained by 
subtracting the elements of B from the corresponding elements of A. 


3. Multiplication of a matrix by a scalar. The product of a matrix A by a 
scalar k is a matrix whose each element is k times the corresponding ele- 
ments of A. 
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4. Multiplication of matrices. Two matrices can be multiplied only when 
the number of columns in the first is equal to the number of rows in the 
second. Such matrices are said to be conformable. Thus if A and B be 
(m x n) and (n x p) matrices, then their product C = AB is defined and 
will be a (m x p) matrix. The elements of C are obtained by the following 
rule: Element c,of C = sum of the products of corresponding elements of 
the ith row of A with those of the jth column of B. 

GQ A 43 

ig yy 

For example, if A= Sinan: 

43; 432. 433 
31 O39 
G4, Mg 143 
Dy, + y2dy, + a43b3, Gy Dig + AyQdo9 + Qy3b39 
Ay,by1 + dggba + Ay3b3) Agi Dyg + dggbo9 + Az3D39 
Asi), + dsgbo +3363, 3, D,2 + gabe + 33039 


AyDyy + Aygb9) + dygb3q_— Ay Dig + Aygbag + A339 


Obs. 1. In general AB # BA even if both exist. 
NOTE 2. If A be a square matrix, then the product AA is defined as A’. 
Similarly A.A? = A’ etc. 


EXAMPLE 3.6 
3-4 6 4 0 4 
Evaluate 3A — 4B, where a-( i o]ene |, 0 i 
Solution: 
9 -12 18 4 0 4 
Wehave3a=| 3 mfnese=(5 0 a 
EXAMPLE 3.7 
0 1 2 1 -2 
If A=}1 2 3] and B=|-1 0 |, form the product AB. Is BA 
23 4 2 -l 


Defined? 
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Solution: 


Since the number of columns of A = the number of rows of B (each 


being = 3). The product AB is defined and 


0.1+1.-14+2.2 0.-24+1.04+2.-1 3-2 
2=| 1142-1432 1.-2-20+3-1/=|5 -5 
2.14+3.-14+42 2.-24+3.04+4.-1 7 -8 

Again since the number of columns of B # the number of rows of A. 


.. The product BA is not defined. 


EXAMPLE 3.8. 


3.2 2 3.4 2 
If A=|1 3. 1}, find the matrix B, such that AB=|1 6 1 
5.4 4 5 6 4 
Solution: 
3.2 2\|l min 
Let AB=]1 3 l1]lp q_ r 
5 3 4ilu vo w 
3I+2p+2u 3m+2q+2v0 3n+2r+2w 
=| [+3pt+u mt+3q+v n+3r+w 
51+33p+4u 5m+3q+4v0 5n4+3r+4w 
3.4 2 
=/1 6 1 (given) 
5 6 4 
Equating corresponding elements, we get 
31 + 2p + 2u = 3, [+3p+u=1, 51+ 3p + 4u =5 (i) 
3m + 2q + 2v =4, m+3q+v=6, 5m + 3q + 4v =6 (ii) 
3n + 2r + 2w = 2, n+3r+w=l, 5n + 3r+4w =4 (iii) 


Solving the equations (i), we get / = 1, p =0,u =0 
Similarly equations (ii) give m = 0, q = 2,0 =0 


and equations (iii) give n =0, r= 0, w = 1 
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Related matrices 


I. Transpose of a matrix. The matrix obtained from a given matrix A, by 
interchanging rows and columns, is called the transpose of A and is de- 
noted by A¢. 


NOTE Obs. 1. Fora symmetric matrix, A¢ = A and for a skew-sym- 
metric matrix, A¢ =— A. 


2. The transpose of the product of two matrices is the product 
of their transposes taken in the reverse order 

ie., (AB) = B’A’. 

3. Any square matrix A can be written as 


1 1 
A= GiAt+A)+ (A-A)=B +e (say) 


1 1 
such that Br=s(A+ AY = Gla + A)= B 


i.e., Bisa symmetric matrix 
— 1 A’ ri 1 A’ = 
and c’ =—(A—A’') =—(A'— A) =—c 
2 2 
ie.,. Cisa skew-symmetric matrix. 
Thus every square matrix can be expressed as the sum of a sym- 
metric and a skew-symmetric matrix. 


II. Adjoint of a square matrix A is the transposed matrix of cofactors of 
A and is written as adj A. Thus the adjoint of the matrix 

a db oy A, Ay As 

d, by Cy|is|B, B, Bs 

a; bs C3 C, Cy, Cz 
III. Inverse of a matrix. [f A is a non-singular square matrix of order n, 


then a square matrix B of the same order such that AB = BA = I, is then 
called the inverse of A, I being a unit matrix. 
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The inverse gf A is written as A“! so that AA! =A!A=I 


Also A7’ =—=— 
[Al 


NOTE Obs. 1. Inverse of a matrix, when it exists, is unique. 


2. (AD)I=A. 
3. (AB) =B" At, 


EXAMPLE 3.9 
1 1 3 
Find the inverse of A=] 1 3 —-3 
—-2 -4 -4 
Solution: 


Here |AJ=| 1 3 -3]=]a, by cy | (say) 


A, A, A,;| [-24 -8 -12 
and adjA=|B, B, B,/=| 10 2 6 
GC 6 ¢,||2 2 2 


-24 -8 -12 
djA 1 
Hence A= i lage 10 2 6 
|4l 8 
2 2 2 


Note: For other methods of finding the inverse of a matrix refer to 
chapter 4. 


Rank of a matrix. If we select any r rows and r columns from any ma- 
trix A, deleting all other rows and columns, then the determinant formed 
by these r x r elements is called the minor of A of order r. Clearly there will 
be a number of different minors of the same order, got by deleting different 
rows and columns from the same matrix. 


Def. A matrix is said to be of rank r when 


I. it has at least one non-zero minor of order r, and 


II. every minor of order higher than r vanishes. 
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Elementary transformations of a matrix. The following operations, 
three of which refer to rows and three to columns are known as elementary 
transformations: 
I. The interchange of any two rows (columns). 
II. The multiplication of any row (column) by a non-zero number. 


III. The addition of a constant multiple of the elements of any row 
(column) to the corresponding elements of any other row 
(column). 


Notation. The elementary row transformations will be denoted by the fol- 
lowing symbols: 

(i) Ry for the interchange of the ith and jth rows. 

(ii) KR, for multiplication of the ith row by k. 

(ii) R, + pR, for addition to the ith row, p times the ith row. 

The corresponding column transformation will be denoted by writing 


C in place of R. These transformations, being precisely those performed on 
the rows (columns) of a determinant, need no explanation. 


NOTE Obs. 1. Elementary transformations do not change either the 

———__ order or rank of a matrix. While the value of the minors may get 
changed by the transformations I and II, their zero or non-zero 
character remains unaffected. 


Equivalent matrix. Two matrices A and B are said to be equivalent if one 
can be obtained from the other by a sequence of elementary transforma- 
tions. Two equivalent matrices have the same order and the same rank. The 
symbol ~ is used for equivalence. 


Elementary matrix. An elementary matrix is that, which is obtained from 
a unit matrix, by subjecting it to any of the elementary transformations. 


Normal form of a matrix. Every non-zero matrix A of rank r, can be 


I, 0 
reduced by a sequence of elementary transformations, to the form F A 
which is called the normal form of A. 
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EXAMPLE 3.10 


Determine the rank of the following matrices: 


0 1 -3 -l1 
jee ie ad Fi 
(i)}/1 4 2 (ii) 310 2 

2 OD 1 1 2 0 
Solution: 


(i) Operate R, — R, and R, — 2R, so that the given matrix 


i 2 :3 
~|0 2 —1]=A (say) 
02 -1 


Obviously, the third order minor of A vanishes. Also its second order 
minors formed by its second and third rows are all zero. But another second 


order minor is 
1 3 
=-10. 
0 -l 


Hence R(A), the rank of the given matrix, is 2. 


(ii) Given matrix 


01-3 -1 01-3 -1 
10 0 0 io oO 2» 
“13 1 -3 -1 "ls o 8 © 
1 1 =8. 1 10 0 0 


[Operating C,-C,,C,-C,] [Operating R,-R,, R,-R,] 


0 1-3 -1 0100 
10 0 0 1000 
“10 0 0 -1 Slay gael 


[Operating R,-3R,,R,—R,| [Operating C,+ 3C,,C,+C,] 


Obviously, the fourth order minor of A is zero. Also every third order 
minor of A is zero. 
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0 1 
But, of all the second order minors, ony Hl =-140. 


Hence R(A), the rank of the given matrix, is 2. 


Consistency of a system of linear equations. Consider the system of m 
linear equations in n unknowns 

Ay4X1 + y9Xq +... + Gy X, =hy 

Ag X + dggXo +... + y,X, = Ko 


am,x, +4,9X) +...¢ a,x, =km 
| eat m2*2 


men 


To determine whether these equations are consistent or not, we find 
the ranks of the matrices 
GQ, Ug-+-Uy Ay Age, ky 


91 gg «++ Agn a9) A993. Aon k, 


A=| ~ and K= 


Gnt @n2a-++4ms Ami Ima+++4nn Kei 
A is the coefficient matrix and K is called the augmented matrix. 
If R(A) # R(K), the equations (i) are inconsistent, i.e., have no solution. 
If R(A) = R(K) = n, the equations (i) are consistent and have a unique 
solution. 
If R(A) = R(K) < n, the equations are consistent but have an infinite 
number of solutions. 


System of linear homogeneous equations. Consider the homogeneous 
linear equations 
A,X + dyoXq +... +4,,x, =O 
Ag X1 + dggXo +...+d9,X, =9 
=0 
Find the rank r of the coefficient matrix A by reducing it to the triangu- 
lar form by elementary row operations. 


AMX, FA, 9Xo +... +a 


man 


I. Ifr = n, the equations (i) have only a trivial solution x, = x, = ... = 
x =0. 
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If r <n, the equations have (n — r) independent solutions. (r can- 
not be > n) The number of linearly independent solutions of (i) is 
(n —r) means, if arbitrary values are assigned to (n — r) of the vari- 
ables, the values of the remaining variables can be uniquely found. 


I. When m < n (i.e., the number of equations is less than the number 
of variables) the solution is always other than x, = x,= ... = xn = 0. 


IH. When m = n (i.e., the number of equations = the number of vari- 
ables) the necessary and sufficient condition for solutions other 
thanx, =x, =... =x, = Oisthat|A | = 0 (i.e., the determinant of the 
coefficient matrix is zero). 


EXAMPLE 3.11 


Test for consistency and solve 


5x + 3y + 7z = 4, 3x + 26y + 2z = 9, Tx + 2y + 10z = 5. 


Solution: 
> oo F |e 4 
We have }3 26 2 |ly|/=]9 
7 2 224z 5 


7 2 10;z 


15 9 21 |ix 
Operate R,-R,,|0 121 -11]/y]= 


15 9 21i)x 12 
Operate 3R,, 5R,,)15 130 10]) y=} 45 
7 2 10 fz | | 


: i 35 21 49 |) x 28 
Operate go O ll -l}ly}=] 3 
35 10 50]/<z 25 


1 
Operate Ry —B, + RyRy, 0 ll -l 


| 
i 


0 0 O 
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In the last set of equations, the number of non-zero rows in the coef- 
ficient matrix is two, and its rank is two. Also the number of non-zero rows 


in the augmented matrix being, its rank of two. 


Now, the ranks of coefficient matrix and augmented matrix being equal, 
the equations are consistent. Also the given system is equivalent to 


dx + 38y + 72 =4, lly-2z=3. 


where z is a parameter. 


7 3 
Hence x= Ti. y= a and z = 0 is a particular solution. 


EXAMPLE 3.12 


Examine the system of equations 3x + 3y + 2% = 1, x + 2y = 4, 


10y + 3z = — 2, 2x — 3y —z = 5 for consistency and then solve it. 


Solution: 
We have 
3 3 2 i 12 0 4 
12 0 4 3 3 2 1 
0 10 317l-|-2|" Jo 10 3 |4I-]-2 
a ae 5 6.28 af 5 
[Interchanging R, and R,] 
i 2 4 
6 
G <3 2 Sid 
or Jo 10 31/7] | -2 [Operating R, — 3R,, R, - 2R,] 
(7 =p (ed 13 
ie @ 4 
6 1 —273 1" 11/3 ee eee 
* lo 0 2973 14 }-|-11673 [Operating Ry +77 Rs,BRy 
GO =17/3 68/3 
12 0 4 
0 1 -2/3\|" 11/3 17 
or }0 0 29/3 i -116/3 [Operating Ry +55 Rs | 
00 0 0 
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Now in the last set of equations, the number of non-zero rows in the 
coefficient matrix is three, and its rank is three. 


Also the number of non-zero rows in the augmented matrix is three, 
and its rank is three. 


Since the ranks of the coefficient and the augmented matrices are 
equal, the given equations are consistent. 


Also number of unknowns = rank of the coefficient matrix. 
Hence the given equations have a unique solution given by 


2 11 29 116 
Ey i ge =— 


~ 873 ae 


These equations show z = — 4, y = 1, x = 2. 


A 


EXAMPLE 3.13 
Investigate the values of A and u so that the equations 
2x + 3y + 5z = 9, Tx + By - 22 = 8, Wn + By +Az =p, 
have (i) no solution, (ii) a unique solution, and (iii) an infinite number 
of solutions. 
Solution: 
2 3 -5]lx 9 
We have |7 3 —2]ly]=|8 
23 Alle u 


The system admits a unique solution if and only if, the coefficient ma- 
trix has the rank of 3.This requires that 


23 5 
7 3 -2/=15(5-A)#0 
oo. 7 


Thus for a unique solution A #5 and w may have any value. IfA =5, the 
system will have no solution for those values of u for which the matrices 
23 5 23 5 9 
A=|7 3 -llandK=/7 3 -2 8 
23 A 23 5 uw 
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are not of the same rank. But A has the rank 2 and K does not have the 
rank of 2 unless u = 9. Thus ifA=5 and uw ¥ 9, the system will have no solu- 
tion. 


IfA =5 and u =9, the system will have an infinite number of solutions. 


EXAMPLE 3.14 
Solve the equations 
Ax + 2y +%+ 3w = 0, 6x + 3y + 424+ Tw = 0, 2x +y+w=0. 
Solution: 
Rank of the coefficient matrix 
4 2 1 8 4 2 1 3 
6 3 4 7-10 0 5/2 5/2 | [OperatingR, -—R,,Ry- FRI] 
2101 0 0 -1/2 -1/2 


4 2 1 3 1 
~|0 0 5/2 5/2 [Operating R; + he ] 
0 0 2 0 


is 2 which is less than the number of variables. 
“. The number of independent solutions = 4 — 2 = 2. 
Also the given system is equivalent to 
4x + 2y+z+3w =0 
z+w=0 
1 
Z=-w,x= By +w). 
Choosing w =k, and x =k,, we have y =- 2k,-k, andz=—-k,. 
EXAMPLE 3.15 


Find the values of k for which the system of equations (3k — 8) x + 3y 
+ 3z = 0, 3x + (3k — 8)y + 3z = 0, 3x + 3y + (3k — 8) z = 0 has a non-trivial 
solution. 

Solution 


For the given system of equations to have a non-trivial solution, the 
determinant of coefficient matrix should be zero. 
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3k-8 3 3 3k-2 3 3 
i.e, 3 3k-8 3 |=Oor |8k-2 3k-8 3 /=0 
3 3 3k-8 3k-2 3 3k-8 

1 3 3 

or (3k—-2)|1 3k-8 3. |=0 [Operating C, + (C, + C,)] 
1 3 3k-8 
1 3 3 

or (8k—2)|0 3k-11 0 |=0 [Operating R, — R,, R,- R,] 
0 0 3k-11 


or (3k —2) (3k -—11)?=0 where k = 2/3 or 11/3. 


Exercises 3.2 


: . 6 4  xty 
1. Find x, y, z and w given that 3 |: ‘/ i 1 sel [ect 3 
1 3 0 2 3 4 
2.If A=|—-1 2 1],B=] 1 2 3],compute AB, BA and show that 
0 0 2 -l 1 2 
AB#BA 
0 5 -3 
3. Express the matrix} 1 1 1 | as the sum of symmetric and skew- 
45 9 
symmetric matrices. 
2 5 3 
4.1IfA=]3 1 2}, find adj A and 4-1. 
1 2 1 
2 2 


1 
5. IfA=2 2 1 -2),prove that A1= A’. 
=2. 2. -=] 
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5 -2 I 
6. Factorize the matrix }7 1  —5 into the form LU, where L is the 
3.¢°7 4 


lower triangular and U is the upper triangular matrix. 


7. Determine the ranks of the following matrices: 


13 4 3 12 3 0 
@13 9 12 3 Gaye ee 2 
13 41 3.2 1 38 
6 8 7 5 


8. Examine for consistency the following equations and then solve these: 
(i) x + 2y =1, Tx + 14y = 12. 
(ii) 2x — 3y + 7z = 5, Bx + y — 32 = 13, 2 + 19y - 472 = 32. 
(iii) x + 2y +z = 3, 2x + By + 22 =5, Bx — 5y + 5z = 2, 3x + Gy —2 = 4. 
9. Investigate for what values of A and w the simultaneous equations 
x+y +z%=6,x + 2y + 82z= 10, x + 2y +z =m, have (i) no solution, (ii) a 
unique solution, (iii) an infinite number of solutions. 


10. Determine the values of A for which the following set of equations may 
possess non-trivial solutions 


3x, +x, —Ax, =0, 4x, — 2x, - 8x, =0, 2Ax, + 4x, + Ax, = 0. 


For each permissible value of é, determine the general solution. 


2 


3.3. Solution of Linear Simultaneous Equations 


Simultaneous linear equations occur quite often in engineering and sci- 
ence. The analysis of electronic circuits consisting of invariant elements, 
analysis of a network under sinusoidal steady-state conditions, determina- 
tion of the output of a chemical plant, and finding the cost of chemical 
reactions are some of the Exercises which depend on the solution of si- 
multaneous linear algebraic equations. The solution of such equations can 
be obtained by Direct or Iterative methods. We describe below some such 
methods of solution. 
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3.4 Direct Methods of Solution 


(1) Method of determinants—Cramer’s rule. Consider the equations 
axtby+cz=d, 
Axx + byy + Coz = dy 
a3x + bgy + 63% = ds 


If the determinant of coefficients is 


a b o 
A=|a, by Cs 
ad; bz C3 


then xA=|xa, by Cy [Operate C, + yC, + zC,] 


axtbytoz b oc] |d, Bb oe, 


=lagxtbyytcyz by col=|dy by Cy 
a,x+bsy+c3z bs cs| |d, b 


Thus x=|d, by cy |=\a, by cy} provided A¥0 (2) 


a d oc} ja b oy 

Similarly y=|d. dy Cgl+ldy by Cy (3) 
a; ds C3| |ad, bs ¢3 
a b dy} ja b 

and Z=|a, by dal+|a, by Co (4) 
a; b, ds} ja; bz cs 


The equations (2), (3), and (4) giving the values of x, y, z constitute 
the Cramer's rule’ which reduces the solution of the linear system (1) to a 
problem in evaluation of determinants. 


' Gabriel Cramer (1704—1752), was a Swiss mathematician. 


116 © Numerical METHODS IN ENGINEERING AND SCIENCE 


NOTE Obs. 1. Cramer’s rule fails for A = 0. 


2. This method is quite general but involves a lot of labor when the 
number of equations exceeds four. For a 10 x 10 system, Cramer’s rule re- 
quires about 70,000,000 multiplications. We shall explain another method 
which requires only 333 multiplications, for the same 10 x 10 system. As 
such, Cramer’s rule is not at all suitable for large systems. 


EXAMPLE 3.16 


Apply Cramer’s rule to solve the questions 


3x + y + 2 = 3, Wn —-3y—-% =-3, n+ 2yt+z=4. 
Solution: 
3. ~¢«Cd2# 2 
Here A=|2 -—3 —-1/=8 
1 2 1 
i 3 1 2 
x=—|-3 -3 —l|;}=-—(8 =] 
7 A (8) > 
4 2 1 
ule 3 2 
=—|2 -3 —lj/=—(16)=2 
= (16) 
1 4 1 
3. ~«2#W 3 
c=< -3 -3)=<(-8)=-1 
an = = = 
1 2 4 


Hence x = 1, y =2 andz=-1. 

(2) Matrix inversion method. Consider the equations 
axtbytcz=d, 
Axx + byy + C92 = dy (1) 
a3x + by +0632 = ds 
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a b CG x d, 
If A=|a, by cy |,X=]y|and D=} d, |, 
a; bs 3 & ds 


then the equations (1) are equivalent to the matrix equation 


AX=D. (2) 
Multiplying both sides of (2) by the inverse matrix A~', we get 
A‘ AX =AtDorIX=A'D se Ar AS 7] 
or X=A'D 


A, A, Aj] | d, 
B, By, Bs |x| d, 
: 6, 6 Gla, 
where A,, B,, etc. are the cofactors of a,, b,, etc. in the determinant | A |. 
Hence equating the values of x, y, z to the corresponding elements in 
the product on the right side of (3) we get the desired solution. 


Obs. This method fails when A is a singular matrix, i.e., | A |= 
NOTE 0. Although this method is quite general, it is not suitable for 
large systems since the evaluation of A by cofactors becomes 
very cumbersome. We shall now explain some methods which 
can be applied to any number of equations. 


EXAMPLE 3.17 
Solve the equations 3x + y + 2z = 3; 2x — 8y —z =-3;x + 2y +z = 4 by 
matrix inversion method. (cf. Example 3.16) 
Solution: 
3 1 2 a bo cy 
Here A=|2 -3 -l]=|a, by cy (say) 
1 2 J] a, b, Cs 
[Ar 42 43] [a =< 4 3 3 1 
y|= TB Be B,|x}d,|=-|-3 1 7 |x|-3]=| 2 
z C.. Gel la. ¢ = <10) [a fed 
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Hence x = 1, y =2,z=-1. 

Gauss elimination method. In this method, the unknowns are elimi- 
nated successively and the system is reduced to an upper triangular system 
from which the unknowns are found by back substitution. The method is 
quite general and is well-adapted for computer operations. Here we shall 
explain it by considering a system of three equations for the sake of clarity. 

Consider the equations 

axtbytcz=d, 
yx + byy + Coz = dy (1) 
a,x + by + C32 = dy 

Step I. To eliminate x from the second and third equations. 

Assuming a, # 0, we eliminate x from the second equation by subtract- 
ing (a,/a,) times the first equation from the second equation. Similarly we 


eliminate x from the third equation by eliminating (a,/a,) times the first 
equation from the third equation. We thus, get the new system 


Assuming a, # 0, we eliminate x from the second equation by subtract- 
ing (a,/a,) times the first equation from the second equation. Similarly we 
eliminate x from the third equation by eliminating (a,/a,) times the first 
equation from the third equation. We thus, get the new system 


axtbytcez=d, 
by y +o, 2=dy (2) 
bs y + C32 = de 
Here the first equation is called the pivotal equation and a, is called the 
first pivot. 
Step II. To eliminate y from third equation in (2). 


Assuming b3 #0, we eliminate y from the third equation of (2), by 
subtracting (b3b5) multiplied by times the second equation from the third 
equation. We thus, get the new system 


axtbytcz=d, 
by y tc, z= dy (3) 


”" 


” 
C3 Z=dz, 
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Here the second equation is the pivotal equation and b; is the new 
pivot. 

Step III. To evaluate the unknowns. 

The values of x, y, z are found from the reduced system (3) by back 
substitution. 


NOTE Obs. 1. On writing the given equations as 


a, b, oc \|x d, 
dy by cy |ly|=| dy | i.e, AX=D, 
a, bs Cy |\2 d, 


this method consists in transforming the coefficient matrix A to the 
upper triangular matrix by elementary row transformations only. 


2. Clearly the method will fail if any one of the pivots a,, bs, or 
cs becomes zero. In such cases, we rewrite the equations in a 
different order so that the pivots are non-zero. 


3. Partial and complete pivoting. In the first step, the numerically 
largest coefficient of x is chosen from all the equations and 
brought as the first pivot by interchanging the first equation with 
the equation having the largest coefficient of x. In the second 
step, the numerically largest coefficient of y is chosen from the 
remaining equations (leaving the first equation) and brought 

as the second pivot by interchanging the second equation with 
the equation having the largest coefficient of y. This process is 
continued until we arrive at the equation with the single variable. 
This modified procedure is called partial pivoting. 


If we are not keen about the elimination of x, y, z in a specified order, then 
we can choose at each stage the numerically largest coefficient of the entire 
matrix of coefficients. This requires not only an interchange of equations 
but also an interchange of the position of the variables. This method of 
elimination is called complete pivoting. It is more complicated and does not 
appreciably improve the accuracy. 


EXAMPLE 3.18 


Apply Gauss elimination method to solve the equations x + 4y —z = —5; 
x+y —6z =- 12; 3x-y—z=4. 
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Solution: 
Check sum 
We have x+4y—-z=-5 -1 (i) 
x+y—6z=-12 —16 (ii) 
3x -y-z=4 5 (iii) 


Step I. To eliminate x, operate (ii) — (i) and (iii) — 3(i): 


Check sum 


— 3y -—5z=-7 = 15 (iv) 
— 138y + 2z=19 8 (v) 
Step II. To eliminate y, operate (v) _13 (iv): 
oe. aur Check sum 
ae 73 (vi) 
3 3 
Step III. By back-substitution, we get 
From (vi): z= ue 2.0845 
71 
7 5/148 81 
From (iv): y=—- =-—-=-114 
rom (iv): y i > ai Fi 08 
From (i): x=—5— i[- *)+(2) = me = 1.6479 
71 71 71 


Hence, x = 1.6479, y = — 1.1408, z = 2.0845. 


Note. A useful check is provided by noting the sum of the coefficients 
and terms on the right, operating on those numbers as on the equations and 
checking that the derived equations have the correct sum. 


1 4 -I}lx —5 
Otherwise: We have |1 1 —6]/y/=|—12 
3 =-l =lll2 4 
1 4 -I1]\x —5 
Operate R,— R, and R,-3R,,}0 -3 —5|/y]/=|-7 
0 -13) 2 |lz 19 
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‘8 4  —-1 |Ix —5 
Operate R; 3 0-3 -5 |ly|=| -7 
0 O T1/38])z 148/3 
Thus, we have z = 148/71 = 2.0845, 
8y = 7-5z= 7 — 10.4225 =— 3.4225, 7.e., y =— 1.1408 
and x =—5-—4y +z=-5 +4 (1.1408) + 2.0845 = 1.6479 
Hence x = 1.6479, y =— 1.1408, z = 2.0845. 


EXAMPLE 3.19 


Solve 10x — 7y + 8z + 5u = 6, — 6x + By —z- 4u = 5, 3x +y + 4y + Llu = 
2, 5x — 9y — 2z + 4u = 7 by the Gauss elimination method. 


Solution: 
Check sum 
We have 10x — Ty + 3z + 5u =6 17 (i) 
— 6x + 8y —z-4u =5 2 (ii) 
3x +y+4z4+llu=2 21 (iii) 
5x — 9y — 22 + 4u =7 5 (iv) 


Step I. To eliminate x, operate 


in-(Z)o,|fca- 3) [e- 0 


Check sum 


3.8y + 0.8 —u = 8.6 12.2 (v) 
3.ly + 3.1z + 9.5u = 0.2 15.9 (vi) 
—5.5y — 3.52 + 1.5u = 4 = 3.5 (vii) 
Step II. To eliminate y, operate G - aa) a - (-F)o0) : 
3.8 3.8 
244736842 + 10.315789u = — 6.8157895 (viii) 
— 2.3421053z + 0.0526315u = 16.447368 (ix) 
—2.3421053 
III. To eliminate z ix) — | —————— | (viii) | : 
Step o eliminate z, operate & ( 3 4473684 cit) 


9.9249319u = 9.9245977 
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Step IV. By back-substitution, we get 
u=1,2=-7,y=4andx=5. 


EXAMPLE 3.20 


Using the Gauss elimination method, solve the equations: x + 2y + 
3% —u = 10, 2x + 8y — 32 -u=1, Wx -y + 22 + Bu = 7, 3x + Qy — 42 + Su = 2. 


Solution: 
1 2 3. -lLi/x 10 
2 3 -3 -l y 1 
We have 2 -] 9) 3 z = 
3 2 -4 3 ilu 


Operate R, — 2R,, R3—2R,, R,- 3R, 


1 2 3 —-Ili]}x —10 
0-1 -9 1|/y| |-19 
0-5 -4 5 ]/z| |-13 
0 -4 -138 6 ]|lu —28 
1 2 3 -liix 10 
Operate R, — 5R,, R,— 4R, Date ob Wg = wa? 
0 O 41 Offz 82 
0 0 2 2 Tu 48 
Thus, we have 41z = 82, i.e., z = 2. 
23z + 2u = 48, i.e., 46 + 2u = 48, all 
-y-%&+u=-19,1e,-y-18+1=-19, .y=2 
x + 2y + 3z-u=10,ie,x+4+6-1=10, Sa eal | 


Hence x= 1, y=2,2=2,u=1. 


Gauss-Jordan method. This is a modification of the Gauss elimination 
method. In this method, elimination of unknowns is performed not in the 
equations below but in the equations above also, ultimately reducing the 
system to a diagonal matrix form, i.e., each equation involving only one 
unknown. From these equations, the unknowns x, y, z can be obtained readily. 


Thus in this method, the labor of back-substitution for finding the un- 
knowns is saved at the cost of additional calculations. 
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Obs. For a system of 10 equations, the number of multipli- 
NOTE cations required for the Gauss-Jordan method is about 500 


whereas for the Gauss elimination method we need only 333 
multiplications. This shows that though the Gauss-Jordan meth- 
od appears to be easier but requires 50 percent more operations 
than the Gauss elimination method. As such, the Gauss elimina- 
tion method is preferred for large systems. 


EXAMPLE 3.21 
Apply the Gauss-Jordan method to solve the equations 
x+y +% = 9; 2x — By + 42 = 13; 3x + 4y + 5z = 40. 


Solution: 
We have xt+ytz=9 (i 
2x — 3y +42 = 18 ii 
3x + 4y +5 = 40 (iii 
Step I. To eliminate x from (ii) and (iii), operate (ii) — 2(i) and (iii) — 3(4): 
xt+ytz=9 (iv 
— 5y + 2z=- v 
y +2z=13 (vi 
Step II. To eliminate y from (iv) and (vi), operate (iv) + : (v) and (vi 
+= (v}: : 
x+ 3 =8 (vii 
~5y + 22=—5 (viii 
12 ; 
re =12 (ix 


Step III. To eliminate z from (vii) and (viii), operate (vii) - (ix) and 


(viii) -2 lin’ 


c=] 
—5y=-15 
12 
oes 


Hence the solution is x = 1, y = 3, z =5. 
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1 1 dix 9 
Otherwise: Rewriting the equations as |}2. —3 4]/ y}=| 13 
3 4 5]lz AO 
1 1 dix 9 
Operate R,—-2R,,R,-3R,,}0 -5 2 y|=|-5 
O 1 2iIhz 13 


1 1 1 x 9 

Operate R, + ERs, 0-5 2 =|-5 
0 O 12/5]z 12 
1 1 1 fix 9 

Operate —R,,5R,}0 5 -—2]|/y|=| 5 

0 0 12 ]4iz 60 


j ‘ 1 1 Idx 9 
Operate R, +—R,,—R,|0 5 Off y}=|15 
“ 6 “12° 
0 Il]lz 5 
1 9 
0 3 
1 5 


i 1 1 
Operate Bre 0 1 
0 0 


1 O O]fx 1 
Operate R, — KR, -R, 0 1 Of;/ys/=}3 
0 0 Lilz 5 


Hence x = 1, y =3,2=5. 


NoTE Obs. Here the process of elimination of variables amounts to 
reducing the given coefficient metric to a diagonal matrix by 
elementary row transformations only. 


EXAMPLE 3.22 


Solve the equations 10x — Ty + 3z + 5u = 6; — 6x + 8y — 2 — 4u = 5; 3x 
+y +42 + Llu = 2; and 5x — 9y — 2z + 4u = 7 by the Gauss-Jordan method. 
(cf. Example 3.19) 
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Solution: 

We have 10x — Ty + 8z + 5u =6 (i) 
— 6x + 8y-—z2-4u =5 (ii) 
3x +y+4z¢+1llu=2 (iii) 
5x — 9y — 22 + 4u =7 (iv) 


Step I. To eliminate x, operate 


r-)oon-{2) u-F2 


10x — Ty + 3z + Su =6 (v) 
3.8y + 0.82 —u = 8.6 (vi) 
3.ly + 3.1z + 9.5u = 0.2 (vii) 
— 5.5y — 3.52 + 1.5u =4 (viii) 


Step II. To eliminate y, operate 


G - (=| co} in - [25 )coo | ea - fa : 


10x + 4.4736842z + 3.1578947u = 21.842105 (ix) 
3.8y + 0.8z —u = 8.6 (x) 

2.4473684z + 10.315789u = — 6.8157895 (xi) 

— 2,3421053z + 0.0526315u = 16.447368 (xii) 


Step III. To eliminate z, operate 


(4473684) Jf. (08 \ Jf. (-2.3421053) 
i (oe) | (ses) ene Jo}: 


10x — 15.698923u = 34.301075 
3.8y — 4.3720429u = 10.827957 
2.4473684z + 10.315789u = — 6.8157895 
9.9247309u = 9.9245975 
Step IV. From the last equation u = 1 nearly. 


Substitution of uw = 1 in the above three equations gives x = 5, y = 4, 
Z=—7. 
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Factorization method’. This method is based on the fact that every 
square matrix A can be expressed as the product of a lower triangular matrix 
and an upper triangular matrix, provided all the principal minors of A are 
non-singular, i.e., ifA = [a,|, then 


A, Ag Ng 
a, ayy 
ay, #0, 4O0,| dg, dg Ag3 | #0, ete. 
M9, Ag9 

43) 432 433 
Also such a factorization if it exists, is unique. 
Now consider the equations 


aX, + AX, v 3X5 = b, 


dX) + A,X, = AX, = b, 


5X, a AX, a A5.X, = b, 
which can be written as AX = B (1) 
GQ G2 3 xy by 
where A=|d5; do, 93. |,X =| X_ [and B=| b, 


43, 432 433 X3 bs 
Let A=LU, 


1 O O Uy, Uy U3 
where L=}1,, 1 Of] andU=! 0 tg tgs 


bis Iso 1 0 0 U33 
Then (1) becomes LUX =B (3) 
Writing UX =V, (4), (3) becomes LV = B 
which is equivalent to the equations v1 = b,, l,,v, + v, = b,, l,.v, + 1,,0, 


+0, =b, 
Solving these for v,, v,, v;, we know V. Then, (4) becomes 


uy X, tu is tu 13%3 = v» WoXo + W5.X = U5, UgnN. = Us; 


from which x,, x,, and x, can be found by back-substitution. 


* Another name given to this decomposition is Triangulization method. 
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To compute the matrices L and U, we write (2) as 


L 0 Offi, Uy Uy a, Ag Ag 
ly, 1 Off O  tyy tz |=] a1 dog  Ao3 
Is, bsg 1]] O 0 uss 43; 439 33 


Multiplying the matrices on the left and equating corresponding ele- 
ments from both sides, we obtain 


(i U ll = a> Us a D195 Uy3 = a5 


(ii Lua, = a5) or Ly = a,/a,; Lt = as) or Ly = a,/a,, 


(iti) 1, U5 + Uy) = Ay, OF Usg = 493 ——— 43 


1 a 

14) = — a, = “3b 

(iv) 1, U1, + lsUo5 = Ay OF L359 = ix thy 
2 


(v) 1,15 + Ugsttg, + Uy = 4, Which gives w,.. 


Thus we compute the elements of L and U in the following set order: 
(i) First row of U, (ii) First column of L, 

(iii) Second row of U, (iv) Second column of L, 

(v) Third row of U. 

This procedure can easily be generalized. 


— _ Obs. This method is superior to the Gauss elimination method 

NOTE and is often used for the solution of linear systems and for find- 
ing the inverse of a matrix. The number of operations involved 
in terms of multiplications for a system of 10 equations by this 
method is about 110 as compared with 333 operations of the 
Gauss method. Among the direct methods, the factorization 
method is also preferred as the software for computers. 


EXAMPLE 3.23 
Apply the factorization method to solve the equations: 


3a + Qy + Tz = 4; In + Sy +Z = 5; Ox + 4y +z = 7. 


Solution: 
1 O Offi, Uy ths 3.2 7 

Let |i, 1 Off] O ty wg l=l2 3 1 (i.e., A), 
Is, ly9 Ii} 0 0  tsg 3.4 1 
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so that 


(i) R,ofU : u,=3, U,,=2, 

(ii) C,ofL : lw, =2, 

1,u,, =3, 
(iii) R,ofU Uys + Ug, = 3, 

Lith its. =, 
(iv) C,ofL : lu, +1,,u,,=4 
(v) R,ofU : lu, +l,u,,+u,,= 1 

1 0 O 3. 2 

Thus A=|]2/3 1 Of=/0 5/38 


1 6/5 1 0 0O 
Writing UX = V, the given system becomes 


1 0 Offe,] [4 
2/3 1 Offe,}=]5 
1 6/5 1|lv,| |7 


Solving this system, we have v, = 4, 


2 7 
gu tan or ce 
6 1 
eh a al or 03 = 
Hence the original system becomes 
3 2 7 x 4 
0 5/3 -11/3]y}=|7/3 
0 O —8/5 || z 1/5 
ie. eased ys oe 
; 3 3 3 5 
By back-substitution, we have 
z=-1/8,y=9/8 and x=7/8. 


SOLUTION OF SIMULTANEOUS ALGEBRAIC EQUATIONS ° 129 


EXAMPLE 3.24 


Solve the equations 10x — Ty + 3z + 5u = 6; — 6x + 8y —z — 4u = 5; 
3x +y +4 + Llu = 2; 5x — 9y — 2z + 4u = 7 by factorization method. 
(cf. Example 3.19) 


Solution: 
1 0 O Offty, thy Uys Ung 10 -7 3 #5 
cae fey 1 0 Ol) O° tig te thy _ =6 § =1 =4 (ic, A) 
a ie 1 OO BW © wel le 1 & ai 
lay yg Lyg 1] 0 0 OO Ug 5 -9 2 4 
so that 
(i) R,of U:u,,=10,u,,=-7,u,,=3,u,,=5 
(ii) C, of L:l,, =—0.6, I, = 0.3, L, = 0.5 
(iii) R, of U: u,, =3.8, u,, = 0.8, u,,=-1 
(iv) C, of L: 1,, = 0.81579, I,, = — 1.44737 
(v) RB, of U:u,, = 2.44737, u,, = 10.31579 
(vi) C,of L:1,,=- 0.95699 
(vii) R, of U: w,, = 9.92474 
1 0 0 olf1l0 -7 3 5 
dink Ae —0.6 1 0 0} 0 3.8 0.8 -l 
0.3 0.81579 1 O}}0 O 2.44737 10.31579 
0.5 —1.44737 -0.95699 1]]/ 0 O 0 9.92474 


Writing UX = V, the given system becomes 


1 0 0 0] [ol] [6 
-0.6 1 0 o} Jo2} [5 
0.3 0.81577 1 o| |o3} }2 
0.5 -1.44737 -0.95699 1] |v4] |7 


Solving this system, we get 
b, =6, 0, =8.6, v, =— 6.81579, v, = 9.92474, 
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Hence the original system becomes 


10 —-7 3 5 x 6 
0 3.8 0.8 -1 y 8.6 
0 0 2.44737 10.31579||z| |—-6.81579 


0 0 0) 9.92474 || u 9.92474 


i.e., 10x — Ty + 3z + 5u =6, 3.8y + 0.8z —u = 8.6, 
2.44737z + 10.31579u =— 6.81579, u = 1. 
By back-substitution, we get 
u=1,2=-7,y=4,x=5. 


Exercises 3.3 


Solve the following equations by Cramer’s rule: 


1.0 4+ 3y + 6z =2; 3x -—y + 42 =9; x -4y + 22 =7. 


2.x+y+2=6.6;x-y+z=2.2;x + 2y + 3z = 15.2. 

3. x°2*/y =e; yale = 4; x°y/z4 = 1. 

4. 20w —wu + uv = 3uvw; 80w + 2wu + 4uv = 19uv; Bow + Twu — uv = 1Tuow. 
5; 


3x + 2y -—z+t=1;4-y-—2z% + 4¢=3; Wx —8y +2 - Qt =— 2; Sx-Qy +324 
2t =0. 


Solve the following equations by the matrix inversion method: 


6.x+y+2=3;x4+ 2y + 3z2=4,x + 4y + 92 =6. 
7.xt+ytz=1;x+2y + 3z=6;x+3y+4z2=6. 
8. 2x -—y + 82 =8;x—- 2y—z=-4; Bn ty — 42 =0. 
9 


~ 2x, +x, + 2x, +x, =6; 4x, + 3x, + 3x, — 3x, =— 1; 6x, — Gx, + 6x, + 12x, = 
36, 2x, + 2x, x, +x, = 10. 


10. In a given electrical network, the equations for the currents i,, i,, and i, 
are 


Bi, +i, +4, = 8; 2, — 31, - 24, =— 5; Ti, + 24, — 5, =0. 


3 
Calculate i, andi, by (2) Cramer’s rule, (b) matrix inversion. 
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Solve the following equations by the Gauss elimination method: 
W1.xtyt+z=9; Qn — 3y + 4z = 13; 3x + 4y +52 = 40 
12. Qn + 2y +z = 12; 3x + Qy + 2z = 8; 5x + 10y — 8z= 10. 
13. 2x -—y+3z=9;xt+y+z2=6;x-y+2z=2. 


14, Qn, + 4x, +x, = 3; 3x, + 2x, — 2x, =-2;x,-x, +2, =6. 
15,90, $2.42, 4%, =4:5, + 1, $8,435, = ein, Fat Oy He, = Oe Eat 
x,+4x,=-6. 
Solve the following equations by the Gauss-Jordan method: 


16. 2x + Sy + 7x = 52; We +y—-—z=O;xty+z=9. 
17. 2xn-—3yt+z=-1;x + 4y + 5z = 25; 3x -4y +z = 2. 


18.x+y+z=9; Ww+y—z=0; QW + 5y + 7z =52. 
19.x + 3y + 3z= 16;x + 4y + 3z = 18, x + 3y +42 =19 
20. 2x, +x, + 5x, +%,=5; x, +x, —3x,+ 4x, = - 1, 
21. 3x, + 6x, — 2x, +x, = 8; 2x, + 2x, + 2x, — 3x, = 2. 
Solve the following equations by the factorization method: 
22. 2n + 3y +z=9;x+ Qy + 3z=6; dx +y +22 =8. 
23. 10x+y+2= 12; 2x + 10y +z = 18; 2x + 2y + 10z = 14. 
24. 10x + y + 22 = 13; 8x + 10y +2 = 14; 2x + 3y + 10% = 15. 


25. 2x, =x, 4%, == 1; 2x,—x, +x,= 1,214 24,-2,==15%, +4, 4+ 2x,=3, 


3.5 Iterative Methods of Solution 


The preceding methods of solving simultaneous linear equations are 
known as direct methods, as these methods yield the solution after a certain 
amount of fixed computations. On the other hand, an iterative method is 
that in which we start from an approximation to the true solution and ob- 
tain better and better approximations from a computation cycle repeated 
as often as may be necessary for achieving a desired accuracy. Thus in an 
iterative method, the amount of computation depends on the degree of ac- 
curacy required. 


For large systems, iterative methods may be faster than the direct 
methods. Even the round-off errors in iterative methods are smaller. In 
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fact, iteration is a self correcting process and any error made at any stage of 
computation gets automatically corrected in the subsequent steps. 


Simple iterative methods can be devised for systems in which the coef- 
ficients of the leading diagonal are large as compared to others. We now 
describe three such methods: 


(1) Jacobi’s iteration method. Consider the equations 
axtbyt+cz=d, 
Axx + byy + Coz = dy (1) 
a3x + bsy +0632 = dy 
If a,, b,, c, are large as compared to other coefficients, solve for x, y, 2, 
respectively. 


Then the system can be written as 


1 

2 

1 
2=—(d; —a3x — b3y) 

C3 


Let us start with the initial approximations x,, y,, x, for the values of x, 
y, 2, respectively. Substituting these on the right sides of (2), the first ap- 
proximations are given by 


1 
x, =—(d, — by yo — €,%) 


ay 
1 

n= 3 — AgXq — Cy%9) 
F) 
1 

% = —(d3 — a3x9 — b3y,) 
C3 


Substituting the values x,, y,,z, on the right sides of (2), the second ap- 
proximations are given by 


1 
X9 a — by, —e\%) 


1 
1 

Yo = b @ — gk] — C92) 
2 
_i1 


% = —(d3 — a3x, — bgy,) 
C3 
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This process is repeated until the difference between two consecutive 
approximations is negligible. 


NOTE Obs. In the absence of any better estimates for x, yy 2), these 
may each be taken as zero. 


EXAMPLE 3.25 
Solve, by Jacobi’s iteration method, the equations 
20x + y — 22 = 17; Sx + 20y —z = — 18; 2x — 3y + 20% = 25. 
Solution: 


We write the given equations in the form 


1 
Bo eo Bx + 8y) 


We start from an approximation x, = y, =%, = 0. 
Substituting these on the right sides of the equations (i), we get 


17 18 25 
m= 55085, mappa —09, 4 = SH 125 


Putting these values on the right sides of the equations (i), we obtain 


1 
(17 — yl + 2z,) = 1.02 


*2 = 950 


1 
Yo = 55 (-18—3x +21) = -0.965 


1 
fq = 5p (25-241 + 3y,) = 1.08 


4 


Substituting these values on the right sides of the equations (i), we have 


1 

X3 = a0 9 + 2z,) = 1.00125 
1 

Y3 = a 28 — 3x, +z) =1.0015 

ae 

20 


(25 — 2x, + 3yy) = 1.00325 
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Substituting these values, we get 


1 
y= 5p (IT — ys + 225) = 1.0004 


1 
yy =—<(-18 — 3xg +25) =— 1.000025 
20 ‘ 
1 
Putting these values, we have 
1 
te = (= 17 = yy +22) =0.999966 
“20 
1 
Ys = po — 3x, +2,)=—1.000078 


1 
25 = eas — 2x, +3y,) = 0.999956 
Again substituting these values, we get 
1 
Xg = 5p (717 — Ys + 25) = 1.0000 
1 
Yo ==~(- 18 — 3x5 +25) = 0.999997 
20 ; 
1 
5 6 = 5p (25 2s + Bys) = 0.900992 
The values in the fifth and sixth iterations being practically the same, 
we can stop. Hence the solution is 


c=lyH==1,2= 1. 


EXAMPLE 3.26 


Solve by Jacobi’s iteration method, the equations 10x + y — z = 11.19, 
x + 1l0y +z = 28.08, -—x +y + 10z = 35.61, correct to two decimal places. 


Solution: 


Rewriting the given equations as 


1 
79 (37-61 +x=y) 


We start from an approximation, Xy =Yy) =%, = 9. 


1 1 
x= Toho +2),y= Jp (28:08 — x — 2). = 
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First iteration 
11.19 28.08 35.61 
x, =—— =1.119,y, =—— = 2.808, z, = = 3.561 
10 10 10 
Second iteration 
1 
t= (IL.19—y +z) = 1.19 


i 
Yo = 7p (28.08 — x — 21) = 2.34 


1 
Hy = (35.61 + 4 — yy) = 3.39 


Third iteration 
1 
X3 = To ttl? — Yo +29) =1.22 


uf 
Y3 = 10 28:08 = NXg — 2%) = 2.35 


Bq = 


Zs (35.61 + x5 — yo) = 3.45 


i 
10 
Fourth iteration 
1 
4 = Tp (LL19 — ys +25) = 1.23 
1 
Ya = 7 (28.08 — x5 — 4) =2.34 


1 
24 — 19 32-6! + X3 = y3) = 3.45 


Fifth iteration 


1 

5 = (L119 — y, +24) = 1.23 
1 

Ys = 9 (28.08 — x4 ~ 24) = 2.34 


1 
= Jp 081 + 4 — y4) = 3.45 
Hence x = 1.23, y = 2.34, z = 3.45 


25 
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EXAMPLE 3.27 
Solve the equations 
10x — 2x,-x,-x,=3 
— 2x, + 10x,—-x,-x,= 15 
= =i 10x, — 2x, = 27 
—x,—x, — 2x, + 10x, =— 9, by the Gauss-Jacobi iteration method. 
Solution: 


Rewriting the given equation as 


y= 3+ 2x, +x, +x,) 

a 1 On " - 

%=75 15+ 2x, +x5 +24) 

—_ 27 +8 Fey 2a 

aT +x, +x, + 2x4) 
1 

Xi —9+x, +x, +2x5) 


~ 10 
We start from an approximation x, =x, =x, =x,=0. 


First iteration 


x, = 0.3, x, = 1.5, x, = 2.7, x,=—-0.9. 
Second iteration 
x= 13 + 2(1.5) + 2.7 + (—0.9)] = 0.78 
= - [15 + 2(0.3) + 2.7 +(—0.9)] = 1.74 
X53 = (27 +0.341.5 + 2(—0.9)]= 2.7 
14 = —{-9 +0.34+1.5 + 2(—0.9)] =0.18 


Proceeding in this way, we get 

Third iteration x, = 0.9, x, = 1.908, x,= 2.916, x,=- 0.108 
Fourth iteration x, = 0.9624, x,= 1.9608, x, = 2.9592, x, = — 0.036 
Fifth iteration x, = 0.9845, x, = 1.9848, x, = 2.9851, x,=- 0.0158 
Sixth iteration x, = 0.9939, x, = 1.9938, x, = 2.9938, x,=— 0.006 
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Seventh iteration x, = 0.9939, x,= 1.9975, x,= 2.9976, x,=— 0.0025 
Eighth iteration x, = 0.999, x,= 1.999, x,= 2.999, x,=— 0.001 
Ninth iteration x, = 0.9996, x,= 1.9996, x,= 2.9996, x, =- 0.004 
Tenth iteration x, = 0.9998, x,= 1.9998, x,= 2.9998, x,= - 0.0001 


Hence x,= 1, x,= 2, x7,=3, x,= 0. 


Gauss-Seidal iteration method. This is a modification of Jacobi’s 
method. As before the system of equations: 


axtbytcz=d, 
yx + boy + Coz = dy (1) 
a3x + by + 03% = ds 


1 
is written as x= 5 — byy —c,2) (2) 
1 
1 
y = —(dy — gx — C92) 
by 
1 


Here also we start with the initial approximations x,, y,, 2, for x, y, 2, 
respectively which may each be taken as zero. Substituting y = y,, z =z, in 
the first of the equations (2), we get 


1 
y= mc = biYyo —C,%p) 
1 


Then putting x = x,,  =2,in the second of the equations (2), we have 


1 
yy = 7 (dy — gx, — C2%q) 
by 
Next substituting x =x,, y = y, in the third of the equations (2), we ob- 
tain 
1 
2, = —(d3 — a3x, — bgy,) 
C3 
and so on, i.€., as soon as a new approximation for an unknown is found, it 
is immediately used in the next step. 


This process of iteration is repeated until the values of x, y, z are ob- 
tained to a desired degree of accuracy. 
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NOTE Obs. 1. Since the most recent approximations of the unknowns 
are used while proceeding to the next step, the convergence in 
the Gauss-Seidal method is twice as fast as in Jacobi’s method. 


2. Jacobi and Gauss-Seidal methods converge for any choice of 
the initial approximations if in each equation of the system, the 
absolute value of the largest co-efficient is almost equal to or is 
at least one equation greater than the sum of the absolute values 
of all the remaining coefficients. 


EXAMPLE 3.28 


Apply the Gauss-Seidal iteration method to solve the equations 20x + 
y — 2z = 17; 3x + 20y —z = — 18; 2x — By + 20z = 25. (cf. Example 3.25) 


Solution: 


We write the given equations in the form 


ras (IT-y +2) (i) 
poe Gib eas) (ii) 
20 
1 
=, (25 — 2x + 3y) (iti) 


First iteration 


1 
Putting y = y,, z =z,in (i), we get x= glT— Yo + 2%) = 0.8500 


1 
Putting x =x,,z=2,in (ii), we have = yy, = on 18 — 3x, +z))=—1.0275 


1 
— (25 —2x, +3y,) = 1.0109 


Putting x =x, y = y, in (iii), we obtain = => 


Second iteration 
1 
Putting y = y,, 2 =2, in (i), we get Xo = Prue — y, + 2z,)= 1.0025 


1 
20 


Putting « =x,, z=, in (ii), we obtain yp =7_(-18— 3x, +z) = —0.9998 


i 
— (25 — 2x, +3y) = 0.9998 


Putting x =x,, y = y, in (iii), we get = 5 
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Third iteration, we get 


1 
X3 = ane? — yo +2z) = 1.0000 


1 


Ys = 5p (— 18 — Bxs +z) = -1.0000 


1 
5 = 5p (25-25 +3y3) = 1.0000 


The values in the second and third iterations being practically the same, 
we can stop. 


Hence the solution is x = 1, y=-1,z=1. 


EXAMPLE 3.29 


Solve the equations 27x + 6y —z = 85; x + y + 54z = 110; 6x + L5y + 2z 
= 72 by the Gauss-Jacobi method and the Gauss-Seidel method. 


Solution: 


Rewriting the given equations as 


x= 5-(85~6y +2) (i) 

yo 622) (ii) 
15 

oe itaned) (iit) 
54 


(a) Gauss-Jacobi’s method 


We start from an approximation x, = y,)=%)= 0 


First iteration 
85 72 110 
x, =—2=3.148,y, == =48,5, =—— = 
27 15 
Second iteration 


1 
Xo = 97 80 Sm +2,) = 2.157 


1 
Yo == (72— Gx, — 2x) = 3.269 


1 
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Third iteration 


iS aby, ile, VAN 


Y3 = (2 — 6x, — 22,5) = 3.685 


1 
23 = 54 blO- Xg — Yg) =1.937 


Fourth iteration 
1 
x4 = a7 — 6y3 +Z3)= 2.401 
1 
Ya = 7g (T2— 6x5 — 25) = 3.545 
1 
Z4 = 5g chlO—« —y3) = 1.923 
Fifth iteration 
1 
ts = 97 8 —6y4 +24) = 2.432 
1 
Ys = 7g? — 6x, — 22,4) = 3.583 


1 
24 = glo X3 — yz) = 1.927 


Repeating this process, the successive iterations are: 
X= 2.423, y= 3.570, z= 1.926 
x, = 2.426, y,= 3.574, z,= 1.926 
X= 2.425, y.= 3.573, z= 1.926 
x)= 2.426, y= 3.573, z= 1.926 
Hence x = 2.426, y = 3.573, z = 1.926 
(b) Gauss-Seidal method 


First iteration 


Putting y = y,=0,2=z,=0in (i), x= get 6yy + %) =3.14 


27 


Putting x =x,, 2 =, in (ii), yl= =(2 — 6x, —2z)) = 3.541 
1 
Putting x =x,, y = y, in (iii), zy = hl0— —y,)=1.913 


SOLUTION OF SIMULTANEOUS ALGEBRAIC EQUATIONS © 141 


Second iteration 


1 
X= 97° —6y, +z) = 2.432 


y2= (2 — 6x, — 2z,) = 3.572 


1 
Zo = 54 10 — x — Yo) = 1.926 


Third iteration 


85 —6y, +z») = 2.426 


1 
X3 aa 


1 


1 
25 = 5 10-45 — y3) = 1.926 


Fourth iteration 
1 
4 = 57 (85 — Gy + %5)= 2.426 
1 


Y4 


Hence x = 2.426, y = 3.573, z = 1.926. 


NOT Obs. We have seen that the convergence is quite fast in the 
Gauss-Seidal method as compared to the Gauss-Jacobi method. 


EXAMPLE 3.30 


Apply the Gauss-Seidal iteration method to solve the equations: 
10x, — 2x,-x,-—%, = 3; — 2x, + 10x, —x, -—x, = 15; —x, —x, + 10x, + 2x, = 27; 
—x,—X, — 2x, + 10x, = —9. (cf. Example 3.27) 


Solution: 
Rewriting the given equations as 


e=0.3+0.255¢ 0a + 0.x, (i) 
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x, = 15+ 0.2x,+0.1x,+ 01x, (ii) 
a= 2.7 +0.1y, 40 1x4 02x, (iit) 
2==0.9 +0ile +0 le 02x, (iv) 


First iteration 
Putting x, = 0, x,= 0, x,= 0 in (i), we get x, =0.3 
Putting x, = 0.3, x,= 0, x,=0 in (ii), we obtain x,= 1.56 


Putting x, = 0.3, x, = 1.56, x,= 0 in (iii), we obtain x,= 2.886 

Putting x, = 0.3, x, = 1.56, x, = 2.886 in (iv), we get x,=— 0.1368. 

Second iteration 

Putting x, = 1.56, x,= 2.886, x,=— 0.1368 in (i), we obtain x, = 0.8869 
Putting x, = 0.8869, x,= 2.886, x,=— 0.1368 in (ii), we obtain x, = 1.9523 
Putting x, = 0.8869, x,= 1.9523, x,=— 0.1368 in (iii), we have x,= 2.9566 
Putting x, = 0.8869, x,= 1.9523, x,= 2.9566 in (iv), we get x,=— 0.0248. 
Third iteration 

Putting x, = 1.9523, x,= 2.9566, x,=-— 0.0248 in (i), we obtain x, = 0.9836 
Putting x, = 0.9836, x,= 2.9566, x,=-— 0.0248 in (ii), we obtain x,= 1.9899 
Putting x, = 0.9836, x,= 1.9899, x,=-— 0.0248 in (iii), we get x, = 2.9924 
Putting x, = 0.9836, x,= 1.9899, x,= 2.9924 in (iv), we get x,= — 0.0042. 
Fourth iteration. Proceeding as above 

x, = 0.9968, x, = 1.9982, x, = 2.9987, x, = — 0.0008. 

Fifth iteration is x, = 0.9994, x, = 1.9997, x,= 2.9997, x,=— 0.0001. 

Sixth iteration is x, = 0.9999, x,= 1.9999, x, = 2.9999, x,=— 0.0001 


Hence the solution is x, = 1, x,= 2,x,=3, x,=0. 

(3) Relaxation method3. Consider the equations 
axtbytcz=d, 
axt+bytcz=d, 
axt+byt+cg=d, 


*- This method was originally developed by R.V. Southwell in 1935, for application to structural engi- 
neering Exercises 
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We define the residuals R,, R,, R_ by the relations 
R, =d, —ax— by — cz 
R, = dy — ax — byy — 9% (1) 
R, = ds — 3x — by — c3% 

To start with we assume x = y =% = 0 and calculate the initial residuals. 


Then the residuals are reduced step by step, by giving increments to the 
variables. For this purpose, we construct the following operation table: 


OR, OR, OR. 
ox = 1 —a, —a, a, 
oy = 1 —b, “Dy —b 3 
0z=1 =, =0, =C, 


We note from the equations (1) that ifx is increased by 1 (keeping y and 
z constant), R., R,, and R_ decrease by a,, a,, a; respectively. This is shown 
in the above table along with the effects on the residuals when y and z are 
given unit increments. (The table is the transpose of the coefficient matrix). 


At each step, the numerically largest residual is reduced to almost zero. 
To reduce a particular residual, the value of the corresponding variable is 
changed; e.g., to reduce R, by p, x should be increased by p/al. 


When all the residuals have been reduced to almost zero, the incre- 
ments in x, y, x are added separately to give the desired solution. 


— Obs. 1. As a check, the computed values of x, y, are substi- 

NOTE tuted in (1) and the residuals are calculated. If these residuals 
are not all negligible, then there is some mistake and the entire 
process should be rechecked. 


2. Relaxation method can be applied successfully only if the 
diagonal elements of the coefficient matrix dominate the other 
coefficients in the corresponding row, i.e., if in the equations (1) 


lax] = |b,] +e] 
\by| = |a2| +|cq| 
les] = |as| + [bs] 


where > sign should be valid for at least one row. 
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EXAMPLE 3.31 
Solve, by the Relaxation method, the equations: 
Ox — 2y +z = 50; x + Sy — 3z = 18; — 2x + Qy + 7z = 19. 
Solution: 
The residuals are given by 
R,=50—9x + 2y -2: 
i = 18 —x — 5y + 32; 
R_=19 + 2x -2y -7z 


The operations table is 


OR, OR, OR. 
Ox = -9 -] 2 
oy = 2 —5 -2 
6z=1 -l -3 -7 
The relaxation table is 
R. R, R 
x=y=z = 0 50 18 19 (i) 
éx=5 5 13 29 (ii) 
6z=14 1 25 1 (iii) 
oy=e ul 0 -9 (io) 
éx=1 2 -1 a7 (v) 
z=] 3 -4 0 ( vi) 
oy =-0.8 14 0) 1.6 (vii) 
dy = 0.23 1.17 0.69 ~0.69 (viii) 
oy =0.13 0 0.56 0.17 (ix) 
oy = 0.112 0.224 0 —0.054 (x) 
Lox = 6.13, Udy = 4.31, Ldz = 3.23. 
Thus x= 6.13, y =4.31, 2 =3.23 


[Explanation. In (i), the largest residual is 50. To reduce it, we give 
an increment dx = 5 and the resulting residuals are shown in (ii). Of these 
R, = 29 is the largest and we give an increment 6z = 4 to get the results in 
(iii). In (vi) R, = — 4 is the (numerically) largest and we give an increment 
dy =— 4/5 =— 0.8 to obtain the results in (vii). Similarly the other steps have 
been carried out. | 
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EXAMPLE 3.32 
Solve the equations: 


10x — 2y — 3z = 205; — 2x + 10y — 2x = 154; — 2x —y + 10x = 120 by Re- 
laxation method. 


Solution: 


The residuals are given by 


R= 205 — 10x + 2y + 32; 
R, = 154 + 2x — 10y + 22; 
R_= 120+ 2x + y — 10z. 


The operations table is 


R R, R. 
x=y=z=0 205 154 120 
ox = 20 5 194 160 
dy =19 43 4 179 
6z=18 97 40 -l 
ox = 10 -3 60 19 
dy =6 9 0 25 
0z =2 15 4 D 
Ox = 2 5 8 9 
6z=1 -2 10 -] 
oy = 0 0 0 


Lox = 32, Udy = 26, dz = 21. 
Hence x = 32, y = 26,z= 21. 


Exercises 3.4 


1. Solve by Jacobi’s method, the equations: 5x — y + z = 10; 2x + 4y = 12; 
x+y +5z =— 1; starting with the solution (2, 3, 0). 
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2. Solve by Jacobi’s method the equations: 
13x + 5y — 3z + u = 18; 2x + 12y +z - 4u = 13; x — 4y + 102 + u = 29; 
2a +y —3z2+9u=3]1. 


3. Solve the equations 27x + 6y —% = 85; x + y +54 = 40; 6x + 15y + 2z = 
72 by 
(a) Jacobi’s method (b) Gauss-Seidal method. 


Solve the following equations by Gauss-Seidal method: 
. Qn +y + 6z=9; Bx + By + 22 = 13; x4 5y4+2= 7. 
28x + 4y —2 = 32; x + 3y + 10z = 24; 2x + 17y + 42 = 35 
10x +y +z = 12; 2x + 10y +z = 13; 2x + 2y + 10z = 14. 
. 7x, + 52x, + 13x, = 104; 83x, + 11x, — 4x, = 95; 3x, + 8x, + 29x, = 71. 


. 3x, —0.1x, — 0.2%, = 7.85; 0.1x, + 7x, —0.3x, =— 19.3; 0.3x, — 0.2x, + 10x. 
= 71.4. 
Solve, by the Relaxation method, the following equations: 


9. 3x + Oy — 2z = 11; 4x + Qy + 132 = 24; 4x — dy + 32 =- 8. 

0. 10x — 2y — 2% = 6; —x + 10y - 22 =7;-x-y+10z=8. 

1.—9x + 3y + 4z + 100 = 0; x — Ty + 3z + 80 = 0; 2x + 3y —5z + 60 = 0. 
2.54x +y +z =110; 2x + 15y + 6z = 72; —x + Gy + 27z = 85 


oN Dw A 


3 


Ill-Conditioned Equations 


A linear system is said to be ill-conditioned if small changes in the co- 
efficients of the equations result in large changes in the values of the un- 
knowns. On the contrary, a system is well-conditioned if small changes in 
the coefficients of the system also produce small changes in the solution. 
We often come across ill-conditioned systems in practical applications. IIl- 
conditioning of a system is usually expected when the determinant of the 
coefficient matrix is small. The coefficient matrix of an ill-conditioned sys- 
tem is called an ill-conditioned matrix. 

While solving simultaneous equations, we also come across two forms 
of instabilities: Inherent and Induced. Inherent instability of a system is 
a property of the given problem and occurs due to the problem being ill- 
conditioned. It can be avoided by reformulation of the problem suitably. 
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Induced instability occurs because of the incorrect choice of method. 
(2) Iterative method to improve accuracy of an ill-conditioned 
system. Consider the system of equations 
ayxtbytoz=d, 
Axx + byy +92 = dy (1) 
a,x + bsy + cz = ds 
Let x’, y’, ’ be an approximate solution. Substituting these values on 


the left-hand sides, we get new values of d,, d,, d, as d1’, d2’, d3’ so that the 
new system is 


qx +bhy' +c2'=d, 
dyx' + byy' + e92' = dy (2) 
a3x' + byy' + C332' = ds, 


Subtracting each equation in (2) from the corresponding equations in 
(1), we obtain 
ax, thy, +o %, =k, 
Axx, + by y, + C9%, = ky (3) 
a,x, + by, +632, =k 


where x,=x-1x',y,=y-y’, ze =x-—2% and ki =di - di’ 


We now solve the system (3) forx,, y,,%, givingx =x’ +x, y=y’ +y, and 
z=2' +z ,,which will be better approximations for x, y, z. We can repeat the 
procedure for improving the accuracy. 


EXAMPLE 3.33 


Establish whether the system 1.01x + 2y = 2.01; x + 2y = 2 is well con- 
ditioned or not? 


Solution: 

Its solution is x = 1 and y = 0.5. 

Now consider the system x + 2.01y = 2.04 and x + 2y = 2 
which has the solution x =— 6 and y = 4. 


Hence the system is ill-conditioned. 
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EXAMPLE 3.34 


An approximate solution of the system 2x + 2y —% = 6;x +y + 2z = 8;-x 
+ 3y + 2z = 4 is given byx = 2.8, y = 1, andz = 1.8. Using the above iterative 
method, improve this solution. 

Solution: 


Substituting the approximate values x’ = 2.8, y’ = 1, z’ = 1.8 in the given 
equations, we get 


9(2.8) +2(1)-1.8=5.8 

2.84+2+2(1.8)=7.4 (i) 

~2,8 +3(1) + 2(1.8)=3.8 

Subtracting each equation in (i) from the corresponding given equa- 
tions, we obtain 

24x, + 2y, —z, =0.2 
x, ty, +22, =0.6 (ii) 
—x, +3y, +22, =0.2 


where x, =x - 2.8, y,=y-1,z%,=2-18. 


Solving the equations (ii), we get x, = 0.2, y, = 0, z, = 0.2. 


This gives the better solution x = 3, y = 1, z = 2, which incidently is the 
exact solution. 


Exercises 3.5 


1. Establish whether the system of equations 
10x + 8y + 9z + 6w = 33, 
6x + Ty + 5z + Sw = 23, 
8x + Oy + 7z + Tw = 32, 
Ox + Ty + 10z + 5w =31 


is well-conditioned or not? 


2. An approximate solution of the equations x + 4y + Tz = 5; 2x + 5y + 8z 
= 7; 3x + Gy + 9.1z= 9.1 is given by x = 1.8, y =— 1.2, z = 1. Improve this 
solution by using the iterative method. 
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3.7 Comparison of Various Methods 


Direct and iterative methods have their advantages and disadvantages 
and a choice of method depends on a particular system of equations. The 
direct methods yield a solution in a finite number of steps for any non- 
singular set of equations, while in an iterative method the amount of com- 
putation depends on the accuracy desired. In general, it is preferable to 
use a direct method for the solution of a linear system. However for large 
systems, an iterative method yields the solution faster and should therefore 


be preferred. 


Gauss elimination method requires more of recording and is quite time 
consuming for operations. As such it is more expensive from the program- 
ming point of view. Among the direct methods, Crout’s triangularization 
method is used more often for the solution of a linear system and as soft- 
ware for computers. 


The rounding off errors also get propagated in the elimination method 
whereas in the iteration techniques only the rounding off errors committed 
in the final iteration have any effect. In general, the iteration methods have 
smaller round-off errors for iteration since it is a self- correcting technique. 
Thus the use of an iterative method for ill-conditioned system is preferable. 


On the other hand, an iterative method may not always converge. 
When it converges, the iterative method is definitely better than the direct 
methods. 


We come across two types of instabilities while solving a linear system 
of equations, i.e., 


Inherent instability and Induced instability. 


Inherent instability occurs due to the set of equations being ill- 
conditioned and as such is a property of the problem itself. It can, however, 
be avoided by a suitable reformulation of the problem. 


On the other hand, induced instability occurs due to an incorrect choice 
of the method of solution. 


3.8 Solution of Non-Linear Simultaneous Equations 


Newton-Raphson method. Consider the equations 
fix, y) =90, g(x, y) =0 (1) 
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If an initial approximation (x,, y,) to a solution has been found by a 
graphical method or otherwise, then a better approximation (x,, y,) can be 
obtained as follows: 

Let x,=x,+h, y,=y,t+k, so that 

fix,+h,y,+k) =0, g(x, th, y,+k) =0 (2) 

Expanding each of the functions in (2) by Taylor’s series to first degree 

terms, we get approximately 


0 0 

fy ag 
OX Yo (3) 
0 0g 

gy th—=-+k—=-=0 
AX dYo 

0 0 
where fy = Aaa = (=) etc. 
OX, ox sisi 


Solving the equations (3) for h and k, we get a new approximation to 
the root as 


x, =x, th, y,=y,tk. 


This process is repeated until we get the values to the desired accuracy. 


NOTE Obs. 1. This method will not converge unless the starting 
values of the roots chosen are close to the actual roots. 


2. The method can be extended to three equations in three vari- 
ables. But it is very cumbersome to obtain a meaningful solu- 
tion unless the entire information about the equations and their 
physical context is available. 


Otherwise. Whenever it is possible, one of the variables may be elimi- 
nated from the given equations giving a single polynomial equation in the 
other variable. Then find this variable to a desired degree of accuracy by 
the Newton-Raphson method. Sometimes the above polynomial equation 
is seen to have a root by trial. If so, reduce this equation to the next lower 
degree equation and find its other root by the Newton-Raphson method. 
Having found this variable to a required degree of accuracy, the other vari- 
able can at once, be found from one of the given equations. 
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EXAMPLE 3.35 
Solve the system of non-linear equations: 
Pty = lar 7. 
Solution: 


An initial approximation to the solution is obtained from a rough graph 
of (1), as x, = 3.5 and y, =— 1.8. 


We have f= x? + y — 1] and g = y? +x — 7 so that 


ax ox 


dg dg 
== 1 == Qy. 
Ox oy 


Then Newton-Raphson’s equations (3) above will be 
Th +k =0.55, h — 3.6k = 0.26. 
Solving these, we get h = 0.0855, k = — 0.0485 
. The better approximation to the root is 
x, =x,+h =3.5855, y,=y,+ k =— 1.8485. 


Repeating the above process, replacing (x,, y,) by (x,, y,), we obtain 
x, = 3.5844, y, = — 1.8482. 


Otherwise. Eliminating y from the given equations, we get 
x,—-220°+x+114=0 

By trial, x = 3 is its root. 

. The reduced equation is x? + 3x? — 13x — 38 = 0 

To find the other root, we apply the Newton-Raphson method to 
f(x) =x? + 3x? — 13x — 38. 

Taking x, = 3.5, we get x, = 3.5844, 

Thus y = 11 —x° gives y = — 1.848 for x = 3.5844 

Also y =- 2 forx =3. 


152 © Numerical METHODS IN ENGINEERING AND SCIENCE 


EXAMPLE 3.36 
Solve the equations 2x? + 3xy + y? = 3, 4x? + 2xy + y? = 30 correct to 
three decimal places, using Newton-Raphson method, given that x, = — 3 
and y, = 2. 
Solution: 
We have f = 2x? + 3xy + y? — 3 and g = 4x? + 2xy + y? — 30, 
0 0 
So that J = 4x +3y, 2 = 3x +2y 
ox oy 
0 0 
= 8r 494.8 =90+2y 
ox oy 
Now fo = 2xq° + 3xoYo + Yo. == 
Bo = 4x + 2xoyo + Yo —30=-2 
0 0 0 0 
ii =-6, ie =—5; 8 ee ee 
OX dYo dX dYo 


Then Newton-Raphson equations (3) above will be 
20h + 2k =-2:6h+5k=1 


Solving these equations, we get h = -= —-0.1364,k = 7 = 0.3636 
. The better approximation is 

x=, +h =—3 - 0.1364 =— 3.1364 

y =Yy tk =2 + 0.3636 = 2.3636 


Repeating the above process and replacing (x,, y,) by (x,, y,), we obtain 
x,=- 3.131, y,= 2.362 


Again proceeding as above and replacing (x,, y,) by (x,, y,), we obtain 
x,=— 3.1309, y,= 2.3617 


Since the values x,, y, and x,, y,are approximately equal, the solution 
correct to three decimal places is x = — 3.131, y = 2.362. 


Exercises 3.6 


1. Solve the equations x” + y =5, y* +x =3. 


2. Solve the non-linear equations x = 2(y + 1), y? = 3xy — 7 correct to three 
decimals. 


- 
4. 


5. 
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Find a root of the equations xy =x + 9, y? =x? + 7. 


Use the Newton-Raphson method to solve the equations x =x + y”, y = 
x? — y? correct to two decimals, starting with the approximation (0.8, 0.4). 


Solve the non-linear equations x° — y? = 4, x° + y? = 16 numerically with 
Xx, =Y, = 2.828 using the Newton-Raphson method. Carry out two itera- 
tions. 


3.9 Objective Type of Questions 


Exercises 3.7 


Select the correct answer or fill up the blanks in the following questions: 


1. 


As soon as a new value of a variable is found by iteration, it is used imme- 
diately in the following equations, this method is called 
(a) Gauss-Jordan method (b) Gauss-Seidal method 


(c) Jacobi’s method (d) Relaxation method. 


. The difference between direct and iterative method of solving simulta- 


neous linear equations is ............ 


. In solving simultaneous equations by the Gauss-Jordan method, the 


coefficient matrix is reduced to ............ matrix. 


. The condition for the convergence of the Gauss-Seidal matrix is that in 


each equation of the system ............ . 


. A matrix in which a, = 0 for i #] is called ............ : 


. Solutions of simultaneous non-linear equations can be obtained using 


(a) Method of iteration (b) Newton-Raphson method 
(c) None of the above. 


. To which form is the coefficient matrix is transformed when AX = B is 


solved by Gauss elimination method? 


. Guass-Seidal iteration converges only if the coefficient matrix is diago- 


nally dominant. (True or False) 
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9. What is “partial pivoting” and “complete pivoting” in the solution of 
linear simultaneous 


equations. 
10. The convergence in the Gauss-Seidal method is ...... than that in Jacobi’s 
method: 
(a) more fast (b) more slow 
(c) slow (d) equal. 


11. By the Gauss elimination method, solve x + y = 2 and 2x + 3y =5. 


CHAPTER 


MATRIX INVERSION AND 
EIGENVALUE PROBLEM 


Chapter Objectives 

e Introduction 

e Matrix inversion 

e Gauss elimination method 
e Gauss-Jordan method 

e Factorization method 

e Partition method 

e Iterative method 

e Eigenvalues and eigenvectors 
e Properties of eigenvalues 
e Bounds for eigenvalues 

e Power method 

e Jacobi’s method 

e Given’s method 


e House-holder’s method 


Objective type of questions 


4.1. Introduction 


There are two main numerical exercises which arise in con- 
nection with the matrices. One of these is the problem of finding 
the inverse of a matrix. The other problem is that of finding the 
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eigenvalues and the corresponding eigenvectors of a matrix. When a student 
first encounters an eigenvalue problem, it appears to him somewhat artifi- 
cial and theoretical only. In fact the computation of eigenvalues is required 
in many engineering and scientific problems. For instance, the frequencies 
of the vibrations of beams are the eigenvalues of a matrix. Eigenvalues are 
also required while finding the frequencies associated with 


(i) the vibrations of a system of masses and springs, 
(ii) the symmetric vibrations of an annular membrane, 
(iii) the oscillations of a triple pendulum, 
(iv) the torsional oscillations of a uniform cantilever, 
(v) the torsional oscillations of a multi-cylinder engine ete. 


Once the physical formulation in any of the above situations is com- 
pleted, all these Exercises have the same mathematical approach: that of 
finding an eigenvalue for a numerical matrix. 


4.2 Matrix Inversion 


In Section 3.2(4), we have already defined the inverse of a non-singular 
square matrix A, to be another matrix B of the same order such that AB = 
BA = 1, I being a unit matrix of the same order. 


The inverse of a matrix A is written as A~ so that AA! = ATA =I. 


Thus the inverse of a matrix exists if and only if it is a non-singular 
square matrix. Also inverse of a matrix, when it exists is unique. 


There are several methods of finding the inverse of a matrix. Of these, 
the method of obtaining the inverse with the help of an adjoint has al- 
ready been illustrated by Example 3.9. But it requires a lot of calculations. 
As such, we shall now, describe some other methods which require less 
of computational labor and can be easily extended to matrices of higher 
order. 


4.3. Gauss Elimination Method 


The method involves the same procedure as explained in Section3.4(3). 
Here we take a unit matrix of the same order as the given matrix A and 
write it as AI. 
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Now making simultaneous row operations on AI, we try to convert A 
into an upper triangular matrix and then to a unit matrix. Ultimately when 
A is transformed into a unit matrix, the adjacent matrix (emerged out from 
the transformation of I) gives the inverse of A. To increase the accuracy, the 
largest element in A is taken as the pivot element for performing the row 
operations. 


4.4 Gauss-Jordan Method 


This is similar to the Gauss elimination method except that instead of 
first converting A into upper triangular form, it is directly converted into 
the unit matrix. 


In practice, the two matrices A and I are written side by side and the 
same row transformations are performed on both. As soon as A is reduced 
to I, the other matrix represents A 


EXAMPLE 4.1 


Using Gauss-Jordan method, find the inverse of the matrix 


1 1 2 
1 3 -3 
-2 -4 -4 


Solution: 


Writing the given matrix side by side with the unit matrix of order 3, 


we have 
1 1 3 1 0 0 
1 3 -3 : 0 1 0 (Operate R, — R, and R, + 2R,) 
-2 -4 -4 0 0 1 
1 1 3: 1 0 0 
~10 2 -6 : -1 1 0 (Operate 1 R, and 1 R,) 
<8 Be Oo ed s 
1 1 oO: 1 0 0 
~10 1 -3 : -1/2 1/2 0 (Operate R, — R, and R, + R,) 


Oo -l 1: 1 0 1/2 
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10 6: 32 1/2 0 
~|0 1 -3 : -1/2 1/2 0 
00-2: 12 1/2 1/2 
[Operate R, + 3R,, R, — =R, and L R,] 
2 . a 2 
1064 8 1 36 
~|0 10: 5/4 1/4 3/4 
001: 14 1/4 1/4 
3 1 3/2 
Hence the inverse of the given matrix is —5/4 -1/4 —-3/4 
-1/4 -1/4 -1/4 


EXAMPLE 4.2 


2 
Using Gauss-Jordan method, find the inverse of the matrix | 2 
1 


wore bw 
Ol RR W 


Solution: 


Writing the given matrix side by side with the unit matrix of order 3, 
we have 


2 2: 3 1 0 0 
211:010 (Operate 5 R,) 
135: 0 0 1 
1 1 3/2 1/2 0 0 
~{2 1 1 0 10 (Operate R, - 2R,, R, - R,) 
13 5 0 O01 
1 3/2: 12 0 0 
~{/0O -l -2 : -1 1 0 (Operate R, + R,, R, + 2R,) 
0 2 7/2: -1/2 01 
0 -1/2 : -1/2 1 0 
~!10 -l -2 : -1 1 0 


0 0 -1/2 : -5/2 2 1 
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10 -1/2 ; -1/2 1 0 

~01 2 : 1 -10 (Operate (— 2) R,) 
0 0 -1/2 : -5/2 2 1 
i © +122 <2 1 0 

~{0 1 2 1 -1l 0 (Operate R, tok, , R, — 2R,) 
0 O 1 5 -4 -2 


100: 2 -1 -l 
~10 10: -9 7 4 
001: 5 -4 -2 


2 -l1 -l 
Hence the inverse of the given matrixis|-9 7 4 
5 —-4 -2 
4.5 Factorization Method 
In this method, we factorize the given matrix as A = LU (1) 


where L is a lower triangular matrix with unit diagonal elements and U 
is an upper triangular matrix 


1 O O Uy, Uj Uy 
Le., L=|l, 1 O| and U=| 0° ty Ugg | [Section3.4(5)1] 
bee ‘das O dy tes 
Now (1) gives A = (LU) = U71L4! (2) 
To find L"', let L~' = X, where X is a lower triangular matrix. 
Then LX=I 
1 0 Olffx; 0 oO] f1 0 0 
i.€., lo, 1 Ol] x Xo. O [=]0 1 2)0 


Is Ls5 1 || «22 X39 =—X33 0 0 1 


Multiplying the matrices on the L.H.S. and equating the corresponding 
elements, we have 


w= ®t, =1,%3=1 (3) 


baee i =0)1.2, +a to, =0 


and Laat - =0 (4) 
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(3) gives U1, =Xgy = Xg3 = 


(4) X) = Lie X31 =~ (5, + LX) and X39 = — Ls 


Thus L~' = X is completely determined. 


To find U", let U' = Y, where Y is an upper triangular matrix. 


Then YU=I 
Yu Yio Vis |} Ur Ug U3 Lf 0 
i.é., O  Yox Yo3 || O Ugg Ugg ]=]O 1 O 


0 O- yz}, O 0 Ugg 0 0 1 


Multiplying the matrices on the L.H.S. and then equating the corre- 
sponding elements, we have 


YY = Li Yoly, = ip Y 3333 = 1 (5) 
Yitys + YjaUog = 9, Yi Uys + Yigts3 + Yi3U33 = 0 
and Yootla; + Yo3U33 = 0 (6) 


From (5), y,, = It, Yoo = Wy, Ya3 = Wttyy 


From (6), Y= YU foo, yl3 arial (Ys + Y glo) M35 Yo3 = Y oly /U 5s. 
We get U' = Y, completely. 
Hence, by (2), we obtain A™. 


EXAMPLE 4.3 


Using the factorization method, find the inverse of the matrix 


50 107 36 
A=|]25 54 20 
31 66 21 


Solution: i wo ly, He. the 
Taking L=|l,, 1 Of} andU=] 0 uy tag 
l 


31 ls5 1 0 0  Us3 


50 107 36 1 O Off, wy ty 
1 


A=LU|25 54 20/=|1, 
31 66 21] |i ky 1]| 0 0 
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50=u,,, lO7 =u 36 =u; 


1? 12? 


25=1,u,,,54=l,u,, +u,,, 20 =1,,u,, + U3 


21? 217 12 22? 21713 


31=1,u,,, 66 =l,u,, +1,,u = tig Pit Oe, 


ole LI 217 12 oy 2 31713 327 23 


or u,, = 50, u,, = 107, u,, = 36, 1, = 1/2, u,, = 1/2, u,, = 2 


> "21 ? 2 93 ? 


1,, = 3/50, 1 _ 17/98, Ugy = 1/25. 


> b35 = 


1 0 0 50 107 36 
Thus 1/2 1 O|andU=} 0 1/2 2 
31/50 17/25 1 0 0 1/25 


To find L~!, let L*! = X. Then LX = 


1 0 Olfx, oO Oo] [1 0 0 
ie., 1/2 1 Olfxa, xo O|=/0 1 0 


1 
= Lo*u +Xq) =0, 


31 1 
23> Let 95 U2 + x3) =0, 
17 
~ 9p 122 + X39 _ 0, X35 = 1. 
1 24 17 
OY X= Xgq = X33 =1,XQ) = 9 7X31 35°" 35 
1 0 0 
Thus Lb '=X= —1/2 1 0 


—24/25 17/25 1 
To find U", let U' = Y. Then YU =] 
Yu Yio Yj3 || 50 107 36 1 0 0 
Le., 0 Yo. Yo || 0 2 2 |=]0 1 0 
0 0 yslfO 0 1/25} |o 0 1 
“. O0y,, = 1, 50y,, + 107y,, = 0, 50y,, + 107y,, + 36y,, = 0 
1 1 1 
9 42 = 15 Ys + 2y33 = 0,55 Ys =, 


or Yi, = 1/90, y,. = 2, Yq = 25, Y4, = — 107/25, y,,=— 100, y,, = 196. 
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1/50 —107/25 196 


Sothat U l=] 0 2 —100 
0 0 25 
1/50 -107/25 196][ 1 0 0 
Hence, A'=U"'E'=| 0 2 -100|/ -1/2 1 0 
0 0 25]|-24/25 17/25 1 
-186 129 196 
=| 95 -66 -100 
-24 17 25 


4.6 Partition Method 


According to this method, if the inverse of a matrix A, of order n is 
known, then the inverse of a matrix A, of order (n + 1) can be determined 
by adding (n + 1)th row and (n + 1)th column to A... 

A, : As X, : Xz 
Suppose ee eee and Av} — eee 
Ajg:@ Xx 
where A,, X, are column vectors and A,’, X, are row vectors (i.e., trans- 


poses of column vectors A,, X,) and @, x are ordinary numbers. 


Also we assume that Al"! is known. Actually A, and X, are column vec- 
tors since their transposes are row vectors. 


Now AAT = I, gives 


AX, tAX. =I, i 

A,X, +A, =0 (2 

AJX, +aX/=0 3 

AX,’ +ax=1 (4 

From (2), X,=— Al A, x 5 

and using this, (4) gives (a —A,’A,1 A,)x = 1. (6 
Hence x and then X, can be found. 

Also from (1), X; = Al" (1, - Asx) (7 
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and using this, (3) gives (a - ASA, 1A) X5 =-ASA, 7 (8) 
whence X,’ and then X, are determined. 


Thus, having found X,,X,,X3 and x, A7! is completely known. 


NOTE Obs. The partition method is also known as the “Escalator method.” 


EXAMPLE 4.4 13 14 6 4 
. ae . : 8 -1 13 9 
Using the partition method, find the inverse of A = a 
Solution: 9 5 16 LL 
13 14 #6 4 
g e118 9| [A,:A, 
We have A=|6 7 3 2 | ane 
A,:a@ 
9 5 16 11 
13 14 6 4 
so that A, =| 8 -1 13]|.A,=|9 
6 7 8 2 
A,=[9 5 16] and a=ll. 
i 94 QO -188 
We find Ay = 94 —54 -3 121 
—62 125 
X, . Xo 
Let 7 ee ee . Then AA™= I 
X's; : a 


,[ % 9 —188]/4 
Hence ASA; 'A,=[9 5 16) -54 -3 121 |I9 
-62 7 125 |l2 


1 
aor 5 16]|-1 
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(a-AjJA,1A,)x=1 [(6) of Section 4.6]] 
1035 
becomes, (11- ae rat i.e.,x =—94 
,[ % 9 -188]/4 0 
Also X, =~ Ay Ayr=—o —54 -3 121 |/9|(-94)=|-1 
-62 7 195 |l2 65 
[(5) of Section 4.7] 
Then. @=AlA, A.) Xi ==ALA 
1035 1 
becomes [1 - =) = ~ 97 416.97,-913] whench X4 =[-416,97,913] 
Finally X,=A,' (I-A,X,’) [(7) of Section 4.6] 
4 —1664 388 3652 
where A,X’, =| 9 |[—416,97,913] =| -3744 873 8217 
2 —832 194 1826 
, | 94 9 —188][1665 —388 —3652 1 oO -2 
X,=5)|-54 -3 lal |[3744 -872 -82l7|/=|-5 1 
-—62 7 125 || 8382 -194 —1825| |287 -67 -630 
1 oOo -2 0 
wif % —- 1 1 -1 
pane | XS ox 287 -67 —630 65 
-416 97 913 -94 


EXAMPLE 4.5 


If A and C are non-singular matrices, then show that 


A oy? A" 0 
B C| |-c"Ba7! co 
0 


Hence find inverse of 


oW CO FR 
Ee oN CO 
ork CO SO 
Co. oS 
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Solution: 

AO PO 
Let the given matrix be M = and its inverse be M7! = 
both in the portioned form where A, B, C, P, Q, R, S are all matrices. 


A O|WP 
worl eles 
- pe ae | 
BP+CR BO+CS| |0 I 
. Equating corresponding elements, we have 
AP +0R=I1,AQ+0S =0, BP+CR=0, BO + CS =I. 
Second relation gives AQ = 0 i.e. Q = 0 as A is non-singular. 
First relation gives AP = I, i.e. P= A™. 
First third equation, BP + CR = 0, i.e., CR=— BP =- BA 
CtCR=-C'BAtT or IR=—C!BAtorR=-—CTBAt 

From fourth equation, BO + CS =I, or CS =I or S=C™ 


2 A! 0 
Hence M = ee =i 
—C BA C 


4.7 Iterative Method 


Suppose we wish to compute A™ and we know that B is an approximate 
inverse of A. Then the error matrix is given by E = AB - I 


or AB=I+E 
(AB)! =(1+ E)‘ ie. Bo A= (I+ EE)! 
or A'=B(U+E)'=BU-E+E?-......), 


provided the series converges. 


Thus we can find further approximations of A™!, by using A‘ = B(1 - E 
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EXAMPLE 4.6 


Using the iterative method, find the inverse of 


1 10 1 0.4 24 —-14 
A=|2 0 Ilj|taking B=} 0.14 0.14 —-0.14 
3.3 2 -—0.85 -38 28 


Solution: 
1 10 1 0.4 24 -14}]}1 0 0 
Here E=AB-I=]2 O 1]| 0.14 014 -0.14//0 1 0 
3 38 2-085 -38 28 |10 0 1 
-—0.05 0 0 
-0.05 0 0) 
—0.08 0.02 —0.02 


0.0025 0 0 
E? =| 0.0025 0 0 
0.0064 —0.0004 —0.0004 
To the second approximation, we have 
A'=B(1-E+E?)=B-BE+ BE? 


0.4 24 —14 —0.02 —0.12 0.07 
=|0.0025 0.14 —0.14}—] —0.02 —0.12 0.07 
-0.85 —-3.8 —2.8 —0.0122 —0.1132 0.0532 


0.001 0.006 —0.0035 0.421 2526 —1474 
+] 0.001 0.006 —0.0035}=| 0.161 0.266 —0.214 
0.0014 0.0095 —0.0053 —0.836 —3.677 2.742 


Exercises 4.1 


Use Gauss-Jordan method to find the inverse of the following matrices: 


2 3 4 
1./4 3 1 
+ 


bo 


2 


N 
eS Poe 
re Ww 
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8 4 3 
3./2 1 1 
12 1 


Use factorization method, to find the inverse of the following matrices: 


3.2 1 
4.}2 3 2 

1 2 2 

2 -2 4 
5./2 3 2 

=l- 1 «=! 

5 -2 1 
6. 1 -5 

3.7 #4 

10 2 Jd 
7.| 2 20 -2 

-2 3 = 10 


Apply the partition method to obtain the inverse of the following matrices: 


11 41 
8/4 3 —-l 
3.5 3 
13 3 2 
143 4 
9. 

13 4 5 
25 3 2 


3-1 


bo 
| 


10. Using iterative method, find the inverse of the matrix A= 


0.1 0.2 


takin = 
ane ie 0.4 
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1 10 1 
11. Apply iterative method to find more accurate inverse of A=|2 0 1], 
3.3 2 


0.43 243 —-1.43 
assuming the initial inverse matrixtobe | 0.14 0.15  —0.14 
—0.85 -3.85 0.85 


4.8 Eigenvalues and Eigenvectors 


If A is any square matrix of order n with elements a,, we can find a col- 
umn matrix X anda constant A such that AX =AX or AX — ie 0 or [A —-AT] 
X=0. 


This matrix equation represents n homogeneous linear equations 


(a,,-A)x, +4,,%, t....+4, x, =0 


1) 
Gh, + (6, -A) tat a,x, =O (1) 


22 2 2n-n 


which will have a non-trivial solution only if the coefficient determinant 
vanishes, i.e., 


Oy A Ay geeeeteteees Ap 
yy digg — Aig, | =O (2) 
Gi | Oegecaveust Gnn ~A 


On expansion, it gives an nth degree equation in A, called the charac- 
teristic equation of the matrix A. Its roots /, (i = 1, 2......n) are called the 
eigenvalues or latent roots and corresponding to eacheigenvalue, the equa- 
tion (2) will have a non-zero solution 


b et Late emer Pe al 


which is known as the eigenvector. Such an equation can ordinarily be 
solved easily. However for larger systems better methods are to be applied. 


Cayley-Hamilton theorem. Every square matrix satisfies its own charac- 
teristic equations i.e., if the characteristic equation for the nth order square 
matrix A is 


| A-AI|=(-1)"A" tk, Ant +... +k =0 
then (-I)n A" +k, A™' +k, =0. 
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EXAMPLE 4.7 
5 4 
Find the eigenvalues and eigenvectors of the matrix k ; 
Solution: 


The characteristic equation is [A —AI] = 0 


ee Node Pom eG 
1.€.,. l 9-4 =or —-TA+0= 
or (1-6) (1-1)=0 «. 1 =6,1. 
Thus the eigenvalues are 6 and 1. 


If x, y be the components of an eigenvector corresponding to the eigen- 


value A, then 
[A-al]xX= mgs a 
7 a ie | 2-Ally - 


-l1 4 lx 
Corresponding to | = 6, we have i “li =0 


which gives only one independent equation — x + 4y = 0 
fa0 giving the eigenvector (4, 1). 
y il 
4 A4Allx 
Corresponding tol = 1, we have i ‘el 0 which gives only one 
independent equation x + y = 0. 
:, = = giving the eigenvector (1, — 1). 


EXAMPLE 4.8 


Find the eigenvalues and eigenvectors of the matrix 


8 -6 3 
A=|-6 7 —-4 
2 -4 3 


Solution: 
The characteristic equation is 
8-A -6 2 
|A-All|=| -6 7-A —-4 |=A> +181? -451=0 
2 -4 3-A 
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or A(A—3)(A—15) =0 -. A=0,3,15. 
Thus the eigenvalues of A are 0, 3, 15. 


If x, y, z be the components of an eigenvector corresponding to the 
eigenvalue A, we have 
8-A -6 2 
(A-A)IX=| -6 7-A -4 
2, -4 3-A 


=0 (i) 


Se a 


A 


Putting 1 = 0, we have 8x — 6y + 2z = 0, — 6x + Ty — 42 = 0, 
2x — 4y + 3z=0. 


These equations determine a single linearly independent solution 
which may be taken as (1, 2, 2) so that every non-zero multiple of this vec- 
tor is an eigenvector corresponding to A = 0. (ii) 


Similarly, the eigenvectors corresponding to A = 3 and A = 15 are the 
arbitrary nonzero multiples of the vectors (2, 1, — 2) and (2, — 2, 1) which 
are obtained from (i). 


Hence the three eigenvectors may be taken as (1, 2, 2), (2, 1, - 2), 
(2.29. J) 


Obs. The eigenvector [x, y, z]’ such that x? + y? + 2° = Lis said 
to be normalized. In particular, if we choose x = 1/3, y = 2/3, 
% = 2/3 in (ii), the corresponding normalized eigenvector will be 
(1/3, 2/3, 2/3). 


NOTE 


EXAMPLE 4.9 


Using the Cayley-Hamilton theorem, find the inverse of the matrix 


Q dod 
(i)A= aa (ii) A=|0O 1 0 
A=|, 2 ii = 

iL ad. g 
Solution: 


(i) The characteristic equation of the matrix is 
1-A 4 


= 2 a ae 
9 3—4| =O or 4,-5=0 
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By Cayley-Hamilton theorem, we have A? — 4A —5 = 0 
Multiplying by A, we get A - 41 - 5A! =0 


a ffl 4 ie) | ee 
we actedecanalft Lt Jae 4) 


(ii) The characteristic equation of the matrix is 
2-A 1 1 
0 1-4 0 |=0or A? -51? +7A-3=0 
1 2 1-A 
By the Cayley-Hamilton theorem, we have A? — 5A? + 7A—3I1=0 (i) 
Multiplying (i) by A“!, we get 


A? -5A+71-3A! =0 or At22(4?-54+7) (ii) 


211 1 0 0 2 -l1 -l 


5 4 4 
. A? -5A+71=10 1 O}-5/O 1 O[+7/0 1 O]=!1 0 3 0) 
4 4 5 1 12 0 0 1 -l1 -l 2 
2 -l1 -l 
Hence from (ii), A’! => 0 3. 06(«OO 
-l -l 2 


4.9 Properties of Eigenvalues 


We now state, some of the important properties of eigenvalues for 
ready reference: 


I. The sum of the eigenvalues of matrix A is the sum of the elements 
of its principal diagonal. 
Il. Ifdis an eigenvalue of matrix A, then 1/A is the eigenvalue of A”. 
Ill. If A is an eigenvalue of an orthogonal matrix, then 1/A is also its 
eigenvalue. 
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IV. [f1,, A, 4, are the eigenvalues of matrix A, then A” has the 
eigenvalues Al”, A,".......,4,m (m being a positive integer). 


V. Ifa square matrix A has n linearly independent eigenvectors, then 
a matrix P can be found such that P~ AP is a diagonal matrix whose 
diagonal elements are the eigenvalues of A. 


The transformation of A by a non-singular matrix P to P™ AP is 
called a similarity transformation. 


VI. Any similarity transformation applied to a matrix leaves its eigen- 
values unchanged. 


4.10 Bounds for Eigenvalues 


If A is an eigenvalue of matrix A, then for some k (1 <k <n), 
|A — Ug. | = lara aa lax Peer loin | =p, (say), 
i.e., all the eigenvalues of A lie in the union of the n circles with centers 
a, and radii p,. 
Proof. Let A be an eigenvalue of an arbitrary square matrix A and X be 


the corresponding eigenvector. Then AX = AX 


or A Me Wrawce +a,x =Ax 


A SG Sota, +a x=Ax, 


If x, be the largest component of X, then |x /x,| <1 (m=1, 2, -++,n) ...(1) 
Dividing the kth equation by x,, we obtain 
Oi I) PaO 


(x, i) ta, Penta, ha )=A 


or A= dy =, (X/x,) + Fy, , (X,_/X,) + +, (0,/%,) 


kh? k-l 


kn 


Taking absolute values on both sides and using the theorem 
|a+b|<|a|+ |b |, we obtain 


[A-a,.|Sla,|+---+]a,,, [+--+ +|q,, | =0, (say) [by (1)] 


This shows that all the eigenvalues of A lie within or on the union of the 
circles with centers a, and radii p,. 
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As A and A’ have the same eigenvalues, the above theorem is also true 
for columns. These circles are called the Gerschgorin circles 


The bounds thus obtained being all independent all the eigenvalues of 
A must lie in the intersection of these bounds. These bounds are called the 
Gerschgorin bounds. 


The above theorem gives us the possible location of the eigenvalues and 
also helps us to estimate their bounds. If any of the Gerschgorin circles is 
isolated, then it contains exactly one eigenvalue. 


EXAMPLE 4.10 


Using Gerschgorin circles, determine the limits of the eigenvalues of 


1 3 2 
the matrix A=|3 4 6 
2 6 I 


Solution: 

The three Gerschgorin circles are 
(a)|z-1|=|3|+|2|=5 

(b) |z-4|=|3|+|6|=9 
(c)|z-1|=|2/+/6|=8 


One eigenvalue lies within the circle having the center at (1, 0) and 
radius 5. 


Second eigenvalue lies within the circle having the center at (4, 0) and 
radius 9. 


Third eigenvalue lies within the circle having the center at (1, 0) and 
radius 8. 


Since the circle (a) lies within the circles (b) and (c), therefore all the 
eigenvalues of A lie within the region defined by (b) and (c). thus —5 <A < 
13 and—7<A <9. 


Hence the limits to the eigenvalues are given by — 7 SA < 13. 
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4.11 Power Method 


In many engineering problems, it is required to compute the numeri- 
cally largest eigenvalue and the corresponding eigenvector. In such cases, 
the following iterative method is quite convenient which is also well-suited 
for machine computations. 


If X,, X,--- X, are the eigenvectors corresponding to the eigenvalues d.,, 
4,, +++ 4,, then an arbitrary column vector can be written as 


X=k X,+k,X, ++ +kX 


non 


Then AX =k, AX, +k, AX, +--+ +k, AX, 
=k AX, +k, AX, ++ +k AX 


n non 


Similarly A°X=kA?X,+kAPX, ++ +k A 2X 


and A'X=k,A, rX, +k,A, 1X, pans +k a, x, 


If|A,|>|A,|>--- >A, |, then, is the largest root and the contribution 
of the term k,A,'X, to the sum on the right increases with r and, therefore, 
every time we multiply a column vector by A, it becomes nearer to the ei- 
genvector X,. Then we make the largest component of the resulting column 
vector unity to avoid the factor k,. 


Thus we start with a column vector X which is as near the solution as 
possible and evaluate AX which is written as A” X" after normalization. 
This gives the first approximation A” to the eigenvalue and X" to the eigen- 
vector. Similarly we evaluate AX" =A X°) which gives the second approxi- 
mation. We repeat this process until [X — X’~”] becomes negligible. Then 
A” will be the largest eigenvalue and X"”, the corresponding eigenvector. 


This iterative procedure for finding the dominant eigenvalue of a ma- 
trix is known as 


Rayleigh’s power method. 


NOTE Obs. Rewriting AX =AX as A! AX =A A Xor X=AA"X. 
We have A7'X = +x 


If we use this equation, then the above method yields the small- 
est eigenvalue. 
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EXAMPLE 4.10 


Determine the largest eigenvalue and the corresponding eigenvector of 


15 4 
the matrix 
1 2 
Solution: 


Let the initial approximation to the eigenvector corresponding to the 


1 
largest eigenvalue of A be X= A 


Then Ax=|> We l=[? las] 7 Jaamxm 
= 1 2fo}-[1}> °fo2 


So the first aporoximation to the eigenvalue is A’ = 5 and the corre- 


0.2 


5 4] 1] [58 1 
We m= = {Oy 
Be ee ; sos bl 58 joa ios 


Thus the second aporoximation to the eigenvalue is 4° = 5.8 and the 


1 
sponding eigenvector is X" = | 


corresponding eigenvector is X°) = . i repeating the above process, 
0.241 
we get 


(3) (3) 

vt agua |A°X 

5 41 1 ]_ wy 
1 2])0.249 0.250 
mr “| Ox) 


2 
1 

(6) x(6) 
nas" Gh i 


Clearly 4° =4 and X® =X upto 3 decimal places. Hence the largest 


eigenvalue is 6 and the corresponding eigenvector is , a 
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EXAMPLE 4.11 
Find the largest eigenvalue and the corresponding eigenvector of the 
2 -1 O 
Matrix }—1 2 —1] using the power method. Take [1, 0, 0]" as the ini- 
0 -l 2 
tial eigenvector. 
Solution: 


Let the initial approximation to the required eigenvector be 
X=[1,0, oY. 


o =f oi 2 1 
Then AX=|-1 2 —-1|}0/=/-1/=2]-0.5|/=¢0x® 
OO =t Bie 0 0 


So the first approximation to the eigenvalue is 2 and the corresponding 
eigenvector 


X(1) =[1, - 0.5, oF. 
9 =f -) 1] [25 1 

Hence Ax =]-1 2 -1]}-05}/=]-2}=|-0.8|=12x® 
6 =i 2 0} 105 0.2 


Repeating the above process, we get 


1 0.87 
AX? =2.8) —1[=49xK™, AX) 33.43) =-1 |= ax 
0.43 0.54 
0.80 0.76 
AX S341) =U HANK. AX? SB Al) Hl asx” 
0.61 0.65 
0.74 
AX® =3.41| -1]=1%x 
0.67 


Clearly 4° =A" and X = X approximately. 
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Hence the largest eigenvalue is 3.41 and the corresponding eigenvector 
is (0.74, — 1, 0.67) 


EXAMPLE 4.12 


Obtain by the power method, the numerically dominant eigenvalue and 
eigenvector of the matrix 


15 -4 -3 
A=/-10 12 -6 
-20 4 -2 


Solution: 


Let the initial approximation to the eigenvector be X = [1, 1, 1]’. Then 


is <4 =3][1 8 -0.444 
AX=|-10 12 -6//1/=] —4 |=-18] 0.222 }=4%x® 
-20 4 —2]|l1] |-18 1 


So the first approximation to eigenvalue is — 18 and the corresponding 
eigenvector is [— 0.444, 0.222, 1]’. 


15 -4 -3][-0.444 1 
Now AX” =]-10 12 -6]| 0.222|=—10.548| —0.105 }=Ax® 
-20 4 -92 l —0.736 


.. The second approximation to the eigenvalue is — 10.548 and the ei- 
genvector is [1, — 0.105, — 0.736)’. 


Repeating the above process 


—0,930 1 
AX®) =-18.948] 0.361] = A2X® AX) =—-18.394| -—0.415 |= 12x 
1 —0,981 
—0.995 1 
AX =—19.698] 0.462 |=4X®, AX® =-19.773] —480 |=4Ox© 
i —0,999 
—(,997 1 


AX‘) =—19,922} 0.490 }= AX, AX =—19.956} 495 ]= Ax) 
1 —0.999 
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Since A =A and X” = X approximately, therefore the dominant 
eigenvalue and the corresponding eigenvector are given by 
-l -l 
A©X®) = 19,956] 0.495 Jice., 20] 0.5 
0.999 1 


Hence the dominant eigenvalue is 20 and eigenvector is [— 1, 0.5, 1]’. 


Exercises 4.2 


1. Find the eigenvalues and eigenvectors of the matrices. 


1 4 1 -2 
(a i b) E : a 


2. Find the latent root and the latent vectors of the matrices 


2 9 1 =o. 9 =8 -6 -2 2 
(a)}0 2 0 (b)| 2 1 -6 (ye &. =] 
1 0 2 af 20° 3G oS al 3B 


3. Using the Cayley-Hamilton theorem, find the inverse of 


1 1 2 211 2 -1 1 
(a)|0 -2 0 (b)}O 1 0 (c)}-1 2 -1 
0 0 8 1 1 2 1 -l 2 
4. Using Gerschgorim circles, find the limits of the eigenvalues of the 
2 2 0 
matrix A=|2 5 0 
0 0 3 


5. Find, by power method, the larger eigenvalue of the following matrices: 


1 2 41 
(a) i A 7 k 4 


6. Find the largest eigenvalue and the corresponding eigenvector of the 


matrices: 
1 3 -l 1 -3 2 
(a)|}3 2 4 (b)|4 4 -1 


-1 4 10 6 38 5 
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95 | 2 
(c)|} 1 3. 0 {taking [1, 0, 0]" as initial eigenvector. 
2 0 -4 


Obs. The iteration method is a special method as it gives the 
largest or the smallest eigenvalue only. Now we shall describe 
three modern methods for finding all the eigenvalues of a real 
symmetric matrix A. 


NOTE 


The eigenvalues of A are given by the diagonal elements when 
A is reduced to either the diagonal matrix D or the lower 
triangular matrix L or the upper triangular matrix U. Thus the 
methods of finding eigenvalues of A are based on reducing A to 
Dor Lor U. 


4.12 Jacobi’s Method 


Let A be a given real symmetric matrix. Its eigenvalues are real and 
there exists a real orthogonal matrix B such that B™! AB is a diagonal ma- 
trix D. Jacobi’s method consists of diagonalizing A by applying a series of 
orthogonal transformations B,, B,,---, B. such that their product B satisfies 
the equation B! AB = D. 


For this purpose, we choose the numerically largest non-diagonal ele- 
by Oy 
ment a, and form a2 x 2 submatrix A, = 5. ie 
ji ji 
Where d, =p which can easily be diagonalized. 
cos@ —sin@ 


sin@  cos@ 


se cos@ sin@ || aii aij || cos@ ~—sin® 
Then B A,B, = 


Consider an orthogonal matrix B, -| | so that B,'=B,’ 


—sin@ cos@||aji ajj||sin@  cosé 


‘ 1 
dj, cos” O + ai sin? 0 + a, sin20, a, cos20 + <(a 4 i )sin 20 
: : : gv 
- : (1) 
dy COS20 + 5 (4a —d; )sin 20, a,sin’ 0+ ai cos’ 0 — a; sin 20 
Now this matrix will reduce to the diagonal form, if a,, COS 2941 (a, = 
2 


a,,) sin 20 = 0 4 
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ie., if 


tan 20 = a 


(2) 
ay Oy 
This equation gives four values of 0, but to get the least possible rota- 
tion, we choose — 7/4 < 0 < a/4. 
Thus (1) reduces to a diagonal matrix. 


As a next step, the largest non-diagonal element (in magnitude) in the 
new rotated matrix is found and the above procedure is repeated using the 
orthogonal matrix B,. 


In this way, a series of such transformations are performed so as to 
annihiliate the non-diagonal elements. After making r transformations, we 
obtain 

B'B,", By, AB, ::-B,_,B, = BAB 

As r + 0, B™ AB approaches a diagonal matrix whose diagonal ele- 

ments are the eigenvalues of A. 


Also the corresponding columns of B = BB,---B_, are the eigenvectors 
of A. 


EXAMPLE 4.13 


Using Jacobi’s method, find all the eigenvalues and the eigenvectors of 
the matrix 


i igo 2 
A=|J2 3 2 
DB ae A 
Solution: 


Here the largest non-diagonal element is a,,=a,, = 2. Also a,, = 1 and 
(all 
33 


24,3 2x2 
= > 
dy, 43, 1-1 
ie., 20 = 2/2 or 9 = 21/4 
cos0 0 —sin@ 12 0 -14/2 
Then B,=| 0 1 O J=/ 0 1 0 Jand By! =B' 
sinOd 0 cosé 1N2 0 0 1N2 


tan 290 = 


[ee) 
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‘. The first transformation gives 


vv2 0 wall} 1 W2 2 | fine o -We 


D,=BU'AB,=| 0 1 O |IW2 3 W2|x! o 1 0 
-V2 0 We} 2 We 1 V2 0 W2 
3.2 0 
=|2 3 0 
00 -1 


Now the largest non-diagonal element is a,, = a,, = 2. Also a,, = 3 and 
d,, = 3. 


aon 2a19 2x2 8 
a1 ~ Ag9 0 
Le., 20 = 2/2 or 0= 1/4. 
cos@ —sin@ 0 1/2 -1/9 0 
Then By, =|sin@ cosO O}= Wp) Wp} 0 
0 0 1 0 0 1 


*. The second transformation gives 


Ue We olfs 2 o Ue -1ha 


0} [5 0 0 
By 'D,B,=|-14/2 We ol/2 3 0 x Wa We o0f=|0 1 0 
1]]}0 0 -1 1] [0 0 


Hence the eigenvalues of the given matrix are 5, 1, — 1 and the corre- 
sponding eigenvectors are the columns of 


Ua o -iye |e We 0) [Ye We 1K 
B=BB,=| 0 1 O Ile Ye ol=life Ve 0 
Uy 0 We |} 9 0 1) | 2 -Ie Ye 


A disadvantage of Jacobi’s method is that the element annihili- 
ated by a transformation, may not remain zero during the sub- 
sequent transformations. Given’s suggested a reduction which 
does not disturb zeros already formed. But instead of leading to a 
diagonal matrix as in Jacobi’s method, the Given’s method leads 
to a tri-diagonal matrix. The eigenvalues and eigenvectors of the 
original matrix have to be found from those of the tri-diagonal 
matrix. 


NOTE 
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EXAMPLE 4.14 


Obtain using Jacobi’s method, all the eigenvalues and eigenvectors of 
the matrix 


1 1 0.5 
A=] 1 1 0.25 
0.5 0.25 2 


Solution: 
Here the largest non-diagonal element is a,, = 1. 


Also a,,=1,4,, =1. 


2a); 2x1 
tan2@=——2— = > 
qq) = 449 0 
Le., 20 = Le = am 
2 4 
cos) -sind 0] [IN2 14a 0 
Then B,=|sinO cos6 O]=|14— 14 0 |andB, -1=B; 
0 0 1 1 0 1 


“. The first transformation is 


We We Off 1 1 ape le We 
D,=B,'AB,=|-l4fa We Ol] 1 1 V4 iife Ye 0 
0 Oo 1 We V4 1 0 0 

2 0 3(R/8 

=| 0 0 —./2/8 
3(ajs 2/8 2 


Now the largest non-diagonal element of + D, is a,, = 3.2/8. Also, 
GQ, = 2, A5, = 2. 


So 


2a. 
tan 20 = ei 0, 1.¢.,20 = a om 
11 — A33 2 
cosO 0 —sind Wp) 0 -1h 
Then B=] 0 1 0 |=! 0 1 0 


sinOd 0 cos0 Wp) 0 Ue 
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.. The second transformation gives 


vv2 0 Wall 2 0 3v2/8 11/2 0 -1W2 


D=57D2.=| 0 tT « 0 0 -V28]1 0 1 0 
-VV2 0 WV21|3V2/8 -V2/8 2 WIW2 0 WW 

2.530 —0.125 0 

=| —0,125 0 —0.125 


0 -0.125 147 
Repeating the above steps, we obtain 


0.998 0.049 0 
B, =| —0.049 0.998 0 
0 0 1 


2.536 —0.000 0.006 
and D3 = B;'D,B; =|—0.000 —0.006 —0.125 
0.006  —-0.125 1469 
Hence the eigenvalues of A are 2.536, — 0.006, 1.469 approximately and 
the corresponding eigenvectors are the columns of 
0.531 —-0.721 -—0.444 
B=B,B,B,;=|0.461 0.686 —0.562 
0.710 0.094 0.698 
4.13 Given’s Method 


If A is a real symmetric matrix, then Given’s method consists of the 
following steps: 


Step I. To reduce A to a tri-diagonal symmetric matrix: 
G1 NM %3 
To begin with, consider the matrix Aj =] a): dg 93 (1) 
M3 493 433 
and the orthogonal rotation matrix B, in the plane (2, 3) as 
1 O 0 
B, =|0 cos@ —sin@ 


1 sinO~ cosé 
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1 0 1 a, Gy Us 1 O 1 
Then B,'A,B,=|0 cos@ —sinO@]) a4. do. dog |X|0 cosO —sin@ 
0 —sin@ cosO | aj, do, G33 0 sin@ cosé 


In the resulting matrix, (1, 3) element =—a,, sin 0 +a,, cos 0. It will be 
zero, if—a,, sin@ +a,, cos 0 =0, i.e., if tan 0 =a,,/a,,. (2) 

Thus with this value of 0, the above transformation gives zeros in (1, 3) 
and (3, 1) positions. 

Now we perform rotation in the plane (2, 4) and put the resulting ele- 
ment (1, 4) = 0. This would not affect the zeros obtained earlier. Proceeding 
in this way, the transformations are applied to the matrix so as to annihilate 
the elements (1, 3), (1, 4), (1, 5),---, (1, n), (2, 4), (2, 5),---, (2, n) in this 
order. Finally we arrive at the tri-diagonal matrix 


mM GQ OO (\eesee% 0 
N Po qa Qeceeee (0) 
p=| 9 q ps a 
= Pn In-1 


0 0 0 OG oid, 


Step II. To find the eigenvalues of a tri-diagonal matrix. 
Let the resulting tri-diagonal matrix after first transformation be 
Gy, &y 0 
G2 Aq Ag (3) 
0 G3 Ags 


Then the eigenvalues of (1) and (3) are the same. To obtain the eigen- 
values of (3), we have 


hin A159 0 
Q1 oa As, |=0= fs (A) [say] 
0 53 ie 
KA) = 1,f,@) =Qy -A= Oy —A fA) 
A 


= (259 A) fi (A)- ais fo (A) 


f(A) 


ay) Q19 
a 


12 22 
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Expanding f,(A) in terms of the third row, we get 


M,-A hp a,-A 0 
fe” ~ (4x 7 4) ae) Ogg — A — A19 Ao 
i.0., f(A) = (Gag —A) F(A) — (yg) fA) (4) 
In oe i recurrence a is 
FA) i Meee (Gk) f(4), 2Sk sn (5) 
The equation fd) = 0 is the characteristic equation which can be solved 


by any standard method. Thus the roots of (5) will be the eigenvalues of the 
given symmetric matrix. 


Step III. To find the eigenvectors of the tri-diagonal matrix. 


If Y is an eigenvector of the tri-diagonal matrix P and if B,, B,,... B, are 
the orthogonal matrices employed in reducing the matrix A to the form 
P, then the corresponding eigenvector of A is given by X = BB... B, Y. 


Obs. 1. The number of rotations required for the Given’s 
method are equivalent to the number of non-tri-diagonal 
elements of the matrix. In the case of a 3 x 3 matrix, only one 
rotation is required; whereas for a 4 x 4 matrix, three rotations 
are needed and so on. 


NOTE 


The amount of computation goes on decreasing from one 
rotation to the next, as the order of the matrix for computation 
also starts reducing. 


Obs. 2. The sequence of functions f,(X), f(A), f(A), f(A) 

is called the Strum sequence. A table of this sequence for 
various values of A is prepaired and the number of changes in 
sign of the Strum sequence is calculated. Then the difference 
between these number of changes of sign for consecutive values 
of A gives an approximate location of the eigenvalues. Once the 
location of the eigenvalues is known, their exact values can be 
found by any iterative method, e.g., Newton-Raphson method. 


EXAMPLE 4.15 


Using Given’s method, reduce the following matrix to the tri-diagonal 
form: 
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Solution: 


There being only one non-tri-diagonal element a,,(= 3) which has to be 
reduced to zero, only one rotation is required. 


To annihilate a,,, we define the orthogonal matrix in the plane (2, 3) as: 


1 0 0 
B=|0 cos@ —siné 
0 sin@ cos@ 
where @ is found from the formula 
3 
tng="B=—=3 and hence sin 9 =3/V10 and cos 6 = 1/V10. 
a9 


@, G&. OO 
A, =BUAB=| Gy. Gy. G3 
0 da3 G33 
where Q,, = 2, a@,,=4,, cos 0 +a,, sin 6 = V10 =3.16, 
Q,, =, Cos” @ + 2a,, sin 8 cos 6 + a,, sin? 8 = 4.3 
G53 = (455 — 4,5) Sin 8 cos 8 + a,,(cos* 6 — sin? 8) = — 1.9 
a 


_ 12 29 - 
33 = Ao SiN” O + d,, COS” O = 3.9. 


2 3.16 0 
Hence A is reduced to the tri-diagonal matrix | 3.16 4.3 —19 
0 -19 3.9 


Note. An alternative procedure for reduction of a symmetric matrix to 
the tri-diagonal form has been suggested by Householder. This method, 
though more complicated, requires half as much computation, as the 
Given’s method. In any case, it is a substantial improvement on the 
Given’s procedure since it reduces an entire row and column by a single 
transformation. In this method, the matrix is reduced to tri-diagonal form 
using elementary orthogonal transformations 


4.14 House-Holder’s Method 


Consider an nth order real symmetric matrix A = [a, ]. This method con- 
sists in pre and post-multiplying A by a real symmetric orthogonal matrix 
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P such that PAP reduces to the tridiagonal form. 


Let the matrix P be of the form P = I — 2ww’ (1) 
ww =wPt+wet--+w2=1 (2) 
Then P’ = (1 - 2ww’)’ = 1 - 2ww’ = P 
And PP = (I — 2ww’)’ (I -— 2ww’) 

=1-—4ww’ + 4ww’. ww’ = 1 [by (2) 


Thus P is a symmetric orthogonal matrix. 
Now take w with first (k — 1) zero components, so that 

w, = [0, 0,---, 0, x,, +++, xn] (3) 
Since w,’w, = 1, we have x,? +x, 


Then PAP, = P,’AP, = PAP, 


24.7272] 


+1 n 


We now form successively A, = PA, , P,; k = 2,3,---,n-1. 


As a first transformation, we determine x’s so that zeros are created in 


the positions 


(1, 3), (1, 4),---, (1, n) and (3, 1), (4, 1),---, (n, 1) 


As a second transformation, we find x’s so that zeros are created in the 


positions (2, 4), (2, 5),---, (2, n) and (4, 2), (5, 2),---, (n, 2). 


After (n — 2) such transformations, we arrive at a tri-diagonal matrix. 


EXAMPLE 4.16 


Using House-holder’s method, reduce the following matrix to the tridi- 


agonal form: 


1 4 8 
A=]4 1 2 
3.2 1 
Solution: 
4 AQ 3 
Let A=]: x2 y3 


Here we take wy = [ 0, et | 
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1 0 0 
so that P=1— QWWyWy =(0 I1- 2x," —1-2x5x, 
0 -1-2x5x5 1-2x, 

Now the element (1, 3) of PAP can become zero only if the correspond- 
ing element in AP is zero. The first row elements of AP are a,,, d,, — 2p,x,, 
d,, — 2px, where p, =4,,X, + 4,, X5- 

. We require that a,,— 2p,x,=0 (i) 

Since the sum of the squares of the elements in any row is invariant 
under an orthogonal transformation, we have 


2 2 2 _ 2 ¢ 2 
Ay + dy) +4)3 = ay + (dy — 2p;X_) +0 


or Ay — 2p, % =+ (a |127 + dag) (ii) 
For the given matrix, (i) and (ii) become 
3-2p x, =0 (iii) 
4—-2p,x, =+, (4 +3?) =45 (iv) 
where p, = 4x, + 3x, 
Multiplying (iii) by x, and (iv) by x, and adding, we get 
3x3 + 4x5 — 2p, ((x3 +15) = 5x, [nap tx5 | 
Leé., Pp, — 2p, =£5x, or p, = F 5x, (v) 


Substituting in (iv), we obtain 4 — 2 (5x,)x, = +5 
which gives x, = 1/V10 orx2 = 3//10 
3 3 


From (iii), 13 = pl =F 10x, [by(v) 
Since x, contains x, in the denominator, we obtain best accuracy if x, is 
large 
3 3 _ 10 1 
“. Choosing =X, ig eT ae lena 7 
Taking + ve sign, we get X: = a and x3 = — 
10 10 


P=I-2w,w) 
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10 0 0 
=|0 1 0|-2/3A/10 |(0,3A/10 ,1A/10 ) 
GO 0-4 1A/10 
1 0 0 
=|0 -4/5 -3/5 
0 -3/5 —4/5 
1 0 0 |f1 4 3]f1 0 0 
Hence PAP=|0 —4/5 —3/5]/4 1 2]|}0 —4/5 —3/5 
0 -3/5 —4/5||3 2 1][0 -3/5 —4/5 
1 0 0 1 —- 0 1 <5 0 
=|0 -4/5 -3/5|/4 -2 1 |=|-5 73/25 -14/25 
0 -3/5 —4/5||3 -11/5 -2/5| | 0 3/5 —11/25 


which is the required tri-diagonal matrix. 


Exercises 4.3 


1. Using Jacobi’s method, find all the eigenvalues and the eigenvectors of 
the matrices: 


5 0 1 2 3 1 
(a)|0 -2 0 (b)|3 2 2 
1 0 5 12 1 
1 1 12 

2. Reduce the matrix] 1 1 1/4] to the tri-diagonal form, using the 
2 4 2 


Householder’s method 
3. Apply Householder’s method, to find the eigenvalues of the matrix 
2 -l1 -l 
-l 2 -1 
-l] -1 2 
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4.15 


. Find the eigenvalues of the matrix 
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1 2 2 


. Transform the matrix |2 1 2/]to the tri-diagonal form using Given’s 


2 2 ] 
method. Hence find the largest eigenvalue and the corresponding ei- 
genvector of the tri-diagonal matrix. 


i 2 
0 0 


Objective Type of Questions 


Ll] J 1 
. The most suitable initial eigenvector out of iH 4 , and 


. Two eigenvalues of the matrix A 


Select the correct answer or fill up the blanks in the following questions: 


. The eigenvalues of a triangular matrix are.......... 


5 3 
. Inverse of 1Sseeedoes 


3.2 


: find tl 
0 to tind the 


; {1 4], . eee 
larger eigenvalue of the matrix = in one iteration, is.......... 


1 
1 |re equal to | each, then the 
2 


ll 
me re bo 
DB wo Ww 


eigenvalues of A“! are.......... 


1 4 
. Eigenvalues of | ATC... 


3 2 


. IfA is an eigenvalue of a matrix A, then 1/A is the eigenvalue of.......... 


6 -2 2 


. The product of two eigenvalues of the matrix ]—2 3 —1|is 16, then 


2 -l1 8 
the third eigenvalue is.......... 


15. 
16. 
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. The Power method works satisfactorily only if the matrix A has a...... 


eigenvalue. 


1 l-i 
. Eigenvalues of the matrix | ATC. eee 


1+i 1 


. IfA is an eigenvalue of an orthogonal matrix, then 1// is also its.......... 


1 2 
. Dominant eigenvalues of 3 4 by the Power method are.......... 


. The eigenvalues of an idempotent matrix are.......... 


. If the eigenvalues of a matrix A are — 4, 3, 1, then the dominant eigen- 


value of A is....... 


22 ] 


-IfA={1 3 1], then 4? =... 


12 2 


The eigenvalue that can the obtained by using the Power method is....... 


IfA is the largest eigenvalue of the matrix A, then the relation giving the 
smallest eigenvalue is....... 


CHAPTER 


EmpirRICAL LAWS AND 
CURVE-FITTING 


Chapter Objectives 


e Introduction 


e Graphical method 


e Laws reducible to the linear law 


e Principle of least squares 


e Method of least squares 


e Fitting a curve of the type y = a + bx’, etc. 


e Fitting of other curves 


e Most Plausible values 


e Method of group averages 


e Laws containing three constants 


e Method of moments 


e Objective type of questions. 


5.1 


Introduction 


In many branches of Applied Mathematics, it is required to ex- 
press a given data, obtained from observations, in the form of a law 
connecting the two variables involved. Such a law inferred by some 
scheme, is known as the empirical law. For example, it may be de- 
sirable to obtain the law connecting the length and the tempera- 
ture of a metal bar. At various temperatures, the length of the bar 
is measured. Then, by one of the methods explained below, a law 
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is obtained that represents the relationship existing between temperature 
and length for the observed values. This relation ship can then be used to 
predict the length at an arbitrary temperature. 


Scatter diagram. To find a relationship between the set of paired observa- 
tions x and y, we plot their corresponding values on the graph, taking one 
of the variables along the x-axis and other along the y-axis, i.e., (x,, y,), (x, 
y,)-»-, (x,, y,,). The resulting diagram showing a collection of dots is called a 
scatter diagram. A smooth curve that approximates the above set of points 
is known as the approximating curve. 


Curve fitting. Several equations of different types can be obtained to ex- 
press the given data approximately. But the problem is to find the equation 
of the curve of “best fit” which may be most suitable for predicting the un- 
known values. The process of finding such an equation of ‘best fit’ is known 
as curve-fitting. 

If there are n pairs of observed values then it is possible to fit the given 
data to an equation that contains n arbitrary constants, and we can solve n 
simultaneous equations for n unknowns. If we desired to obtain an equation 
representing these data but have less then n arbitrary constants, then we 
can have recourse to any of these four methods: Graphical method, method 
of least-squares, method of group averages, and method of moments. The 
graphical method and the method of averages fail to give the values of the 
unknown constants uniquely and accurately, while the other methods do. 
The method of least squares is probably the best to fit a unique curve to a 
given data. It is widely used in applications and can be easily implemented 
on a computer. 


5.2 Graphical Method 


When the curve representing the given data is a linear law y = mx + c; 
we proceed as follows: 


(i) Plot the given points on the graph paper taking a suitable scale. 


(ii) Draw the straight line of best fit such that the points are evenly 
distributed about the line. 


(iti) Taking two suitable points (x,, y,) and (x,, y,) on the line, calculate 
m, the slope of the line and c, its intercept on the y-axis. 
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When the points representing the observed values do not approximate 
to a straight line, a smooth curve is drawn through them. From the shape 
of the graph, we try to infer the law of the curve and then reduce it to the 
form y =mx +c. 


5.3. Laws Reducible to the Linear Law 


We give below some of the laws in common use, indicating the way 
these can be reduced to the linear form by suitable substitutions: 


1. When the law is y = mx" + 
Taking x" = X and y = Y, the above law becomes Y = mX +c 
2. When the law is y = ax". 
Taking logarithms of both sides, it becomes log, ,y = log, a +n log, x 
Putting log, x = X and log, y = Y, it reduces to the form 
Y=nX +c, where c = log a. 


3. When the law is y = ax" +b log x. 


n 
y x 
=a 


Writing it 
riting it as ine eee 


+b and taking x"/log x = X and y/log x = Y, the 


given law becomes, Y = aX + b. 


4. When the law is y = ae". 
Taking logarithms, it becomes log,, y = (b log,, e)x + log,,a. 
Putting x = X and log, y = Y, it takes the form Y = mX +c 


where m = b log, and c = log,,a. 
5. When the law is xy = ax + by. 
Dividing by x, we have y = b* +a, 


Putting y/x = X and y = Y, it reduces to the form Y = bX +a. 


EXAMPLE 5.1 


R is the resistance to motion of a train at speed V; find a law of the type 
R=a+bV? connecting R and V, using the following data: 


V (km/hr): 10 20 30 40 50 
R (kg/ton): 8 10 15 21 30 
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Solution: 

Given law is R =a + bV? (i) 
Taking V? =x and R = y, 

(i) becomes, y = a + bx (ii) 


which is a linear law. 
Table for the values of x and y is as follows: 


a: 100 400 900 1600 2500 
y: 8 10 15 21 30 


Plot these points. Draw the straight line of best fit through these points 
(Figure 5.1). 


Ya 
40 
(2500,30) 
30 
N iJ 
20 L (1600.21) 
(900,15) |M 
10 [ | (400,10) 
o) (200.8) 
(0,0) 400 800 1200 1600 2000 2400 2800 
FIGURE 5.1 
Slope of this line (= b) 
_MN 21-156 
~ LM 1600-900 700 
= 0.0085 nearly. 
Since L(900, 15) lies on (ii), 
15=a+ 0.0085 x 900, 
where a = 15 — 7.65 = 7.35 nearly. 
EXAMPLE 5.2 


The following values of x and y are supposed to follow the law 
y =ax’ +b log ,x. Find graphically the most probable values of the constants 
a and b. 


Emp 


RICAL LAWS AND CurVve-FITTING ® 197 


x 2.85 3.88 4.66 5.69 6.65 7.77 8.67 
y 16.7 26.4 35.1 AT.5 60.6 77.5 93.4 
Solution: 
Given law is y = ax? + b log, x 
a lee i 
logigx — log 10* 
Putting x/log,,x =X and y/ log .x = Y, 
(i) becomes Y=aX+b (ii) 
This is a linear law. 
Table for the values of X and Y is as follows: 
X = x/log, x 17.93 25.56 32.49 42.87 53.75 67.80 80.83 
Y = y/log,, x 35.59 44.83 52.50 69.90 73.65 87.04 99.56 
Points P, P, P, P, P, P, P. 


Plot these points and draw the straight line of best fit through these points 


(Figure 5.2). 


45 , 


35 APs 


g/15 25 35 45 


FIGURE 5.2 


Slope of this line (=a) = 


> X 


MP; _73.65-52.50 21.15 _ 


PM 53.75-32.49 21.96 | 


0.99 
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Since P, lies on (ii), therefore, 


52.50 = 0.99 x 32.49 + b 
where b = 20.2 


Hence (i) becomes y = (0.99) x? + (20.2) log,*. 


EXAMPLE 5.3 


The values of x and y obtained in an experiment are as follows: 


x 2.30 3.10 4.00 4,92 5.91 7.20 
y 33.0 39.1 50.3 67.2 85.6 125.0 


The probable law is y = ae’. Test graphically the accuracy of this law 
and if the law holds good, find the best values of the constants. 


Solution: 
Given law is y = ae” (i) 
Taking logarithms to base 10, we have 
log, ,! = log,,a + (b log, e) x 
Putting x = X and log, ,! = Y, it becomes 
y = (b log,,e) X + log, a (ii) 


Table for the values of X and Y is as under: 


X=x 2.30 3.10 4.00 4.92 5.91 7.20 
Y= log,, y 1.52 1.59 1.70 1.83 1.93 2.10 
Points P 1 P, P, P : P, 6 


Scale: 1 small division along x-axis = 0.1 
10 small divisions along y-axis = 0.1. 
Plot these points and draw the line of best fit. As these points are lying 


almost along a straight line, the given law is nearly accurate (Figure 5.3). 


-, MN 
Now the slope of this line (= blog 10°) = a 0.12 


0.12 


O$10 @ 


= 0.12 X 2.303 = 0.276 


where b= 
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Since the point L (4, 1.71) lies on (ii), therefore, 
1.71 =0.12 x 4+log,, a where a = 17 nearly. 


0.276 x 


Hence the curve of best fit is y = 17 e 


» X 


0 
(2, 1.5)3 4 5 6 7 8 
FIGURE 5.3 


Exercises 5.1 


1. Ifp is the pull required to lift the weight by means of a pulley block, find 
a linear law of the form p =a + bw, connecting p and w, using the follow- 


ing data: 
w(Ib): 50 70 100 120 
p(lb): 12 15 21 95 


Compute p, when w = 150 lb. 


2. Convert the following equations to their linear forms: 
(i) y =ax + bx? (ii) y = b/[x(x — a)]. 
3. The resistance R of a carbon filament lamp was measured at various 
values of the voltage V and the following observations were made: 
62 70 78 84 92 
69.2 67.8 66.3 


Voltage V... 
Resistance R... 73 70.7 
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Assuming a law of the form R = a b, find by graphical method the best 
values of a and b. M 


4. Verify if the values of x and y, related as shown in the following table, 
obey the law y=a+ bv/x. If so, find graphically the values of a and b. 


x 500 1,000 | 2,000 | 4,000 | 6,000 
y: 0.20 0.33 0.38 0.45 0.51 


5. The following table gives the pressure p and the volume v at various 
instants during the expansion of steam in a cylinder. Show that the equa- 
tion of the expansion is of the form pu" =c and find the values of n and c 
approximately. 


p: 200 | 100 50 30 20 10 
v: 1.0 1.7 2.9 4.8 5.9 10 


6. The following values of T and / follow the law T = al". Test if this is so 
and find the best values of a and n. 


T=1.0 15 2.0 2.5 
1=25 56.2 100 1.56 


Fit the curve y = ae’ to the following data: 
xX: 0 2 4 
y. | 51 | 10 | 31a 


The following are the results of an experiment on friction of bearings. 
The speed being kept constant, corresponding values of the coefficient 
of friction and the temperature are shown in the table: 


t: 120 110 100 90 80 70 60 
LU: 0.0051 | 0.0059 | 0.0071 | 0.0085 | 0.00102 | 0.00124 | 0.00148 


If w and ¢ are given by the law mu = ae”, find the values of a and b by 
plotting the graph for w and t. 


5.4 Principle of Least Squares 


The graphical method has the obvious drawback of being unable to give 
a unique curve of fit. The principle of least squares, however, provides an 
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elegant procedure of fitting a unique curve to a given data. 
Let the curve y =a + bx + ex? + «+» + kx” 


be fitted to the set of data points (x,, y,), («,, Y,),.-5 (x, y,)- 


0! 


FIGURE 5.4 

Now we have to determine the constants a, b, c,... k such that they 
represents the curve of best fit. In the case of n = m, when substituting the 
values (x, y,) in (1), we get n equations from which a unique set of n con- 
stants can be found. But when n > m, we obtain n equations which are more 
than the m constants and hence cannot be solved for these constants. So we 
try to determine the values of a, b, c, --- k which satisfy all the equations as 
nearly as possible and thus may give the best fit. In such cases, we apply the 
principle of least squares. 


At x =x,, the observed (experimental) value of the ordinate is yi and the 
corresponding value on the fitting curve (1) isa +bx,+ ex? +++ +kx" (=n, 
say) which is the expected (or calculated) value (Figure 5.4). The difference 
of the observed and the expected values, i.e., y,—,( = e,) is called the error 
(or residual) at x = x,. Clearly some of the errors @,, €,,-:-, e, will be positive 
and others negative. Thus to give equal weightage to each error, we square 
each of these and form their sum, i.e, E=e?+e2+--- +e. 


The curve of best fit is that for which e’s are as small as possible, i.e., the 
sum of the squares of the errors is a minimum. This is known as the prin- 
ciple of least squares and was suggested by a French mathematician Adrien 
Marie Legendre in 1806. 


Obs. The principle of least squares does not help us to 
NOTE ; ; 
determine the form of the appropriate curve which can fit a 
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given data. It only determines the best possible values of the 
constants in the equation when the form of the curve is known 
before hand. The selection of the curve is a matter of experience 
and practical considerations. 


5.5 Method of Least Squares 


For clarity, suppose it is required to fit the curve y = a + bx + cx* to 
a given set of observations (x,, y,), (Xj Y,), «+» (Xs y;). For any x,, the ob- 
served value is y,and the expected value is 7,= a + bx,+ cx, so that the error 
eee ls 
. The sum of the squares of these errors is 
E=e, +e," +...65" 
=[y, —(a+bx, + ox? )P + ly. — bry + ex,” )P +...+lys —(a + bx +cx,")P 
For E to be minimum, we have 


— =0=-2[y, —(a+ bx, +cex;)P — ly, —(a + bry +cx3)] 


=.= Ays —(at brs + ers) P 


= =0=-2m ly —(a+ bx, +x; )|— 2x5[y —(a + bx, +.cx5)] (2) 
—-+-— Qrolys —(a + bas +cx2)] 

=0=-2uHly —(atbx, + ex; )|— 2x5 [ys —(a + bx, +.ex3)] (3) 
=.= 2x2 [ys —(a + brs + cx)] 


Equation (1) simplifies to 
yy ty tet y5 = SatD(x, $29 te +4x5) telay tay te +23) 
i.e, Lyi = 5a + b>xi + cxi" (4) 
Equation (2) becomes 
XY, $XoYo tot xsy5 = alxy txy te +45) + Day +45 +. +43) 
+e(xP + x3 +--+ +23) 
ie, Sony, =aDn, bY? +2309 
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Similarly (3) simplifies to 
Sx7y, =adx7 +bdxP +cedx;' 
The equations (4), (5) and (6) are known as normal equations and can 


be solved as simultaneous equations in a, b, c. The values of these constants 
when substituted in (1) give the desired curve of best fit. 


da?’ ab?’ dc’ 


of a, b, c just obtained, we will observe that each is positive, i.e,. 
Eis a minimum. 


NOTE Obs. On calculating and substituting the values 


Working procedure 
(a) To fit the straight line y =a + bx 
(i) Substitute the observed set of n values in this equation. 


(ii) Form normal equations for each constant, i.e., Ly = na + bx&x, 
Lay = adx + bin’. 


[The normal equation for the unknown a is obtained by mul- 
tiplying the equations by the coefficient of a and adding. The 
normal equation for b is obtained by multiplying the equations 


by the coefficient of b (i.e. x) and adding. | 


(iii) Solve these normal equations as simultaneous equations for a 


and b. 


(iv) Substitute the values of a and b in y = a + bx, which is the 
required line of best fit. 


(b) To fit the parabola: y =a + bx + cx? 
(i) Form the normal equations Ly = na + b=x + cXx? 
Xaxy = aXx + bin? + clin? and Lx?y = adx? + bIx? + cXx* 


[The normal equation for c has been obtained by multiplying the 
equations by the coefficient of c (i.e., x*) and adding. ] 


(ii) Solve these as simultaneous equations for a, b, c. 


(iit) Substitute the values of a, b, c in y = a + bx + cx*, which is the 
required parabola of best fit. 


(c) In general, the curve y =a + bx + cx? + --- + kx"! can be fitted to a 
given data by writing m normal equations. 
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EXAMPLE 5.4 


If P is the pull required to lift a load W by means of a pulley block, find 
a linear law of the form P = mW + c connecting P and W, using the follow- 


ing data: 
PSI? 15 21 5 
W =50 70 100 120 


where P and W are taken in kg-wt. Compute P when W = 150 kg. 
Solution: 
The corresponding normal equations are 
YP =4c+m>DW | li) 
DWe=cYW+m>w° 
The values of XW etc. are calculated by means of the following table: 


W P Ww WP 

50 12 2500 600 

70 15 4900 1050 

100 21 10000 2100 

120 25 14400 3000 

Total = 340 73 31800 6750 


. The equations (i) become 73 = 4c + 340m and 6750 = 340c + 31800m 
2c + 170m = 365 (ii) 

34c + 3180m = 675 (iii) 

Multiplying (ii) by 17 and subtracting from (iii), we get m = 0.1879 

«. from (ii), c = 2.2785 

Hence the line of best fit is P = 2.2759 + 0.1879 W 

When W = 150 kg, P = 2.2785 + 0.1879 x 150 = 30.4635 kg. 


1.€., 


and 


EXAMPLE 5.5 
Fit a straight line to the following data: 
x 6 7 a 8 8 8 9 10 
yl 5 | 5] 4 )5 | 4/3 3 | 3 
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Solution: 
Let the straight line be y = ax + b. 
Then the normal equations are Xy = ax + 9b 
Luxy = aXx? + bix (i) 


The values of Xx, Xy etc. are calculated below: 


x y xy x? 
6 D 30 36 
7 5 35 49 
v4 4 28 16 
8 5 40 64 
8 4 32 64 
8 3 24 64 
9 4 36 81 
9 3 27 81 
10 3 30 100 
Xx = 72 Ly = 36 Zxy = 282 Xxn2 = 588 
. The equations (i) become 36 = 72a + 9b and 282 = 588a + 72b 
ie., 8a+b=4 (it) 
98a + 12b = 47 (iti) 


Multiplying (ii) by 12 and subtracting from (iii), we get a =— 0.5. 
From (ii), b = 8. 
Hence the required line of best fit is y = — 0.5x + 8. 


EXAMPLE 5.6 


Fit a second degree parabola to the following data: 


x 0 1 2 3 4 
y 1 1.8 1.3 2. 6.3 
Solution: 


Let u =x —2 and v =y so that the parabola of fit y =a + bx + cx? becomes 
v=A+ But Cu? 
The normal equations are 
Yw=5A+BIu+CXu> or 129=5A+10C 
Luv = ALut+ BIu> +CXu> or 11.3=10B 


Duy = Adu? + Bru? +Cru* or 33.55=10A+34C 
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Solving these as simultaneous equations, we get 
A = 1.48, B = 1.13, C = 0.55 
.. (i) becomes; vo = 1.48 +1.13u + 0.55u? 
y = 1.48 + 1.13(« — 2) + 0.55(« — 2)? 
Hence y = 1.42—1.07x +0.55x° 


NOTE Obs. For the sake of convenience and ease in calculations, it 

is sometimes advisable to change the origin and scale with the 
substitutions X = (x — A)/h and Y = (y — B)/h, where A and B are 
the assumed means (or middle values) of x and y series, respec- 
tively and h is the width of the interval. 


EXAMPLE 5.7 
Fit a second degree parabola to the following data: 
x=1.0 1.5 2.0 2.5 3.0 3.5 4.0 
y=1.1 1.3 1.6 2.0 2.7 3.4 4.1 
Solution: 


We shift the origin to (2.5, 0) and take 0.5 as the new unit. This amounts 
to changing the variable x to X, by the relation X = 2x — 5. 


Let the parabola of fit be y = a + bX + cX?. 


The values of =X etc. are calculated as below: 


x X y Xy xe X’y x3 Xx! 
1.0 3 ik 3.3 9 9.9 27 81 
1.5 2 1.3 —2.6 4 5.2 8 16 
2.0 - 1.6 —1.6 1 1.6 =I 1 
2.5 0 2.0 0.0 0 0.0 0 0 
3.0 1 2271. 2.7 I 27 i I 
3.5 2 3.4 6.8 4 13.6 8 16 
4.0 3 4.1 12.3 9 36.9 oF 81 

Total 0 16.2 14.3 28 69.9 0 196 


The normal equations are 
Ta + 28c = 16.2, 28b = 14.3, 28a + 196c = 69.9 
Solving these as simultaneous equations, we get 
a=2.07,b =0.511, c =0.061. 
y = 2.07 + 0.511X + 0.061 xe 
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Replacing X by 2x — 5 in the above equation, we get 
y =2.07+0.511 (2x —5) + 0.061 (2x — 5)? 

which simplifies to y = 1.04 — 0.198x + 0.244:° 

This is the required parabola of best fit. 


EXAMPLE 5.8 


Fit a second degree parabola to the following data: 


x: | 1989 } 1990 | 1991 | 1992 | 1993 | 1994 | 1995 | 1996 | 1997 
y: | 352 356 357 358 360 361 361 360 359 


Solution: 


Taking uw = x — 1993 and v = y — 357, the equation y = a + bx + cx? 


becomes 
o=A+But+Cu? (i 
x u= l = Uv u? u-D uw ut 
x — 1993 y — 357 

1989 4 352 5 20 16 —80 —64 256 
1990 =3 356 =] 3 9 9 27 81 
1991 =2 357 0 0 4 0 -8 16 
1992 —l 358 1 =] 1 1 =] 1 
1993 0 360 3 0 0 0 0 0 
1994 1 361 4 4 1 4 1 1 
1995 2 361 4 8 4 16 8 16 
1996 3 360 3 9 9 27 27 81 
1997 4 359 2 8 16 32 64 256 
Total xu = 0 Yo=11 | Suv =51 | Lu? = 60} Su?2v0 =-— 9} Du2=0 | Sut = 708 


The normal equations are 
Xv =9A+BXu+C2Xu or ll=9A+60C 
17 
Duv = ALu + BIu? + Cru? or 51 = 60B or B= 0 


Suv = Adu? + BIu? + Cu* or —9 = 60A + 708C 


694 17 247 
On solving these equations, we get A = 


- (Gi)b ec al 
. (i) becomes 531 90" 994" 
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_ 694.17 O47 : 
17 247x3986 247 , 
st <= x 


694 33881 247 2 
cle (1993)° +—x 
20 924 924 


231 20 924 
or y=3— 1694.05 — 1061792.32 + 357 + 0.85x + 1065.52x — 0.267x" 


or Y= 


Hence y =—1062526.37 + 1066.37x — 0.267x° 


Exercises 5.2 


1. By the method of least squares, find the straight line that best fits the fol- 
lowing data: 


Xi 1 2 3 4 5 
y: 14 27 40 55 68 


2. In some determinations of the value v of carbon dioxide dissolved in a 
given volume of water at different temperatures 0, the following pairs of 
values were obtained: 


0=0 5 10 15 


v=1.80} 1.45 1.18 1.00 


Obtain by the method of least squares, a relation of the form v = a + bé 
which best fits to these observations. 


3. A simply supported beam carries a concentrated load P(Ib) at its mid- 
point. Corresponding to various values of P, the maximum deflection Y 
(in) is measured. The data are given below: 


P: | 100 120 140 160 180 200 
Y: | 0.45 0.55 0.60 0.70 0.80 0.85 


Find a law of the form Y =a + bP. 


4. The result of measurement of electric resistance R of a copper bar at 
various temperatures t° C are listed below: 

t: i9 | 2 | 30 | 36 | 40 | 45 | 50 

R: 76 77 79 80 82 83 85 


Find a relation R = a + bt when a and bD are constants to be determined 
by you. 
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5. A chemical company, wishing to study the effect of extraction time (t) 
on the efficiency of an extraction operation (e) obtained the data shown 
in the following table: 

t: | 27 | 45 | 41 | 19 | 3 | 39 | 19 | 49 | 15 | 21 

e: | 57 | 64 | 80 | 46 | 62 | 72 | 52 | 77 | 57 | 68 


Fit a straight line to the given data by the method of least squares. 


6. Find the parabola of the form y =a + bx + cx2 which fits most closely 
with the observations: 


X: 3 2 1 0 1 2 3 
y: 4.63 |} 2.11 0.67 0.09 0.63 2.15 4.58 


7. By the method of least squares, fit a parabola of the form 
y =a+bx +cx’, to the following data: 


x: 2 4 6 8 10 
y: 6.07 | 12.85 | 31.47 | 57.38 | 91.29 
Fit a parabola y =a + bx + cx? to the following data: 


x: 1 2 3 + 5 6 7 8 9 
Y: 2 6 7 8 10 11 11 10 9 


8. The velocity V of a liquid is known to vary with temperature T according 
to a quadratic law V =a + b T + CT”. Find the best values of a, b, c for 
the following table: 

ce 1 2 3 4 5 6 7 

V: 2.31 2.01 3.80 1.66 1.55 1.46 1.41 


9. The following table gives the results of the measurements of train resis- 
tance, V is the velocity in miles per hour, R is the resistance in pounds 
per ton: 


V: 20 40 60 80 100 120 
R: 5.0 9.1 14.9 22.8 33.3 46.0 
If R is related to V by the relation R=a+bV + cV’, find a, b and c. 


5.6 Fitting A Curve of the Type 


(1) y=a+ bx’? (2) y = ax + bx? 
(3) y =ax + b/x (4) ax? + b/x. 
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(1) y=a+ bx* 
Putting x* = X, we have y =a +bX (i) 
which is a linear equation. Its normal equations are 

Ly = na + bxX; LyX = aXX + buX2 


Solving these, we get a and b. Substituting these values of a, b and re- 
placing X by x’ in (i), we obtain the desired equation of best fit. 


(2) y = ax + bx’ 
Rewriting this equation as y/x = a + bx and putting y/x = Y, we have 
Y=atbx (i) 
Its normal equations are 
LY =na + b&Ux; VYx = adx + bXx? 


Solving these we get a and b. Replacing Y by y/x in (i), we obtain the 
desired equation of best fit. 


(3) y=ax+bhx 

Rewriting this equation as xy = ax? + b 

and putting x” = X and xy = Y, we have Y =b + aX (i) 

Its normal equations are 

LY = nb + aXX; IXY = bux + aXX? 

Solving these equations, we get a and b. Replacing X by x* and Y by xy 
in (i), we obtain the desired equation of best fit. 

(4) y = ax’ + b/x 

Rewriting this equation as xy = ax3 + b and putting «3 = X and xy = Y, 
we have 

Y=b+aXx (i) 
Its normal equations are 
LY =bn + aXX; XXY = bux + X? 


Solving these equations, we get a and b. Replacing X by x° and Y by xy, 
we obtain the desired equation of best fit. 
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EXAMPLE 5.9 


Find the least squares fit of the form y =a, + a,x° to the following data 


x: =] 0 1 2 
y: 2 5 3 0 
Solution: 
Putting x? = X, we have y =a,+a,X (i) 


. The normal equations are 
Ly = 4a + a,ZX; XXy =a,2ZX + a, ZX’. 
The values of =X, =X? etc. are calculated below: 


x y x x XY 
a 2 1 1 2 
0 5 0 0 0 
1 3 1 1 3 
2 0 4 16 0 
Sy = 10 EX =6 EX2=18 | SXY=5 


. The normal equations become 10 = 400 + 6a,; 5 = 600 + 18a, 
Solving these equations we get, a, = 4.167, a, =- 1.111. 
Hence the curve of best fit is 

y= 4.167 —1.111Xi.e., y= 4.167 — 1.11 1x. 


EXAMPLE 5.10 


Using the method of least squares, fit the curve y = ax° + b/x to the fol- 
lowing data: 


X: 1 2 3 + 
y: -1.51 |] 0.99 8.88 7.66 


Solution: 
Rewriting the given equation as xy = ax® + b and putting x° = X and 
xy = Y, we get 
Y=aXt+b (i) 
.. The normal equations are 
LY =aXX + 4b; UXY = adXX? + brUX 
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The values of =X, XY etc. are calculated below: 


X y X=x Y=xy XY xX 

1 -1.51 1 -1.51 -1.51 1 

2 0.99 8 1.98 15.84 64 

3 3.88 27 11.64 314.28 729 

4 7.66 64 30.64 1960.96 4096 
xX = 100 LY = 42.75 |XXY = 2289.57) XX? = 4890 


“. The normal equations become 


42.75 = 100a + 4b 
2289.57 = 4890a + 100b 
Solving these equations, we get a = 0.51, b = — 2.06 
Hence the curve of best-fit is Y = 0.51X + 2.06 


2.06 
ie., xy = 0.51x° — 2.06 or y=051x* ——— 
x 


5.7 __ Fitting of Other Curves 


(1) y =ax? 
Taking logarithms, log10 y = log,, a + blog, ,x 
i.é., Y=A+bDX 
where X = log,, x, Y =log,, y and A = log,, a. 
. The normal equations for (i) are 
LY = nA + b=X, UXY = ALX + DIX? 


from which A and b can be determined. Then a can be calculated from 


A=log,,a. 
(2) y =ae”* (Exponential curve) 


Taking logarithms, log,, y = log,, a + bx log,, e 


ieé., Y =A + Bx where Y =log,, y, A = log,, a and B =b log, e 


Here the normal equations are LY = nA + B&Xx, XxY = AXx + BXx’ from 
which A, B can be found and consequently a, b can be calculated. 


(3) xy* = b (or pv’ =k) 
Taking logarithms, log,, x +a log,, y = log,, b 


(Gas equation) 
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or logy y = : logig b- Digs 10* 
a a 
This is of the form Y = A + BX 
1 1 
where X = logy) x, Y = logy) y, A= 7 logo b,B= = 


Here also the problem reduces to finding a straight line of best fit 
through the given data. 


EXAMPLE 5.11 


An experiment gave the following values: 


v (ft/min): 350 400 50 600 


t (min): 61 26 7 2.6 


It is known that v and ¢ are connected by the relation v = at’. Find the 
best possible values of a and b. 


Solution: 

We have log10 v = log,“ + b log10' 

or Y=A + bX where X = log, ft, Y = log, v, A = log, a. 

.. The normal equations are 

LY = 4A + Dux (i) 
XXY = AXX + bxX? (ii) 


Now XX etc. are calculated as in the following table: 


v t X =log, Y =log,v XY x? 
350 61 1.7853 2.5441 4,542 3.187 
400 26 1.4150 2.6021 3.682 2.002 
500 7 0.8451 2.6990 2.281 0.714 
600 2.6 0.4150 2.7782 1.153 0.172 

Total 4.4604 10.6234 11.658 6.075 


.. Equations (i) and (ii) become 
4A + 4.46b = 10.623; 4.46A + 6.075b = 11.658 
Solving these, A = 2.845, b =— 0.1697 


“. a=antilog A = antilog 2.845 = 699.8. 


214 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


EXAMPLE 5.12 


Predict the mean radiation dose at an altitude of 3000 feet by fitting an 


exponential curve to the given data: 


Altitude (x): 50 450 780 1200 | 4400 | 4800 | 5300 
Dose of radiation (y): 28 30 32 36 51 58 69 
Solution: 
Let y = ab‘ be the exponential curve. 
Then log10/ = log a +x log, 
or Y=A + Bx where Y = log,, y, A = log,, a, B = log, b 
.. The normal equations are 
LY =7A+B%Yx (i) 
Xx Y=AXx + B Xx? (ii) 
Now =x etc., are calculated as follows: 
Y=log,,y xY ca 
1.447158 72.3579 2500 
1.477121 664.7044 202500 
1.505150 1174.0170 608400 
1.556303 1867.5636 1440000 
1.707570 7513.3080 19360000 
1.763428 8464.4544 23040000 
1.838849 9745.8997 28090000 
x = 16980 11.295579 29502.305 72743400 
.. Equations (i) and (ii) become 


Hence y(at x = 3000) = 44.874 i.e., 44.9 approx. 


11.295579 = 7A + 16980B 


29502.305 = 16980A + 72743400B 
Solving these equations, we get A = 1.4521015, B = 0.0000666289 


log, y = Y = 1.4521015 + 0.0000666289 x 
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EXAMPLE 5.13 


Fit a curve of the form y = ae” to the following data: 


x: 0 1 2 3 
y: 1.05 2.10 3.85 8.30 


Solution: 
Taking logarithms of both sides, the given equation becomes 
log,, y =log,, a + bx log,, e 
ie, Y=A+bx where Y=log,,y, A=log,,a, B=b log,,e 
The normal equations are 
XY = 4A + BXx; UxY = AXx + BX’. 
Now x, XY etc. are calculated as in the table below: 


x Y Y x xY 

0 1.05 0.0212 0 0 

1 2.10 0.3222 1 0.3222 

2 3.85 0.5855 4 1.1710 

3 8.30 0.9191 9 2.7573 
dx =6 XY = 1.8480 Xa? = 14 Rx Y = 4.2505 


Substituting these values in the normal equations, we get 
4A + 6B = 1.848; 6A + 14B = 4.2505. 

Solving these equations, A = 0.0185, B = 0.2956 

“. a =antilog A = 1.0186, b = B/log10 e = 0.6806 

Hence the required curve of best fit is y = 1.0186 e°°™, 


EXAMPLE 5.14 


The pressure and volume of a gas are related by the equation pV’ = k, 


y and k being constants. Fit this equation to the following set of observa- 
tions: 


p (kg/em*):| 0.5 1.0 1.5 2.0 2.5 3.0 


V (litres): 1.62 1.00 0.75 0.62 0.52 0.46 
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Solution: 


We have log,, p + y log,, V = log,, k 


1 1 
or log,y V =—log)) k——log,, P 
Y Y 


1 1 
or Y=A+BX where X = logyy P, Y = logi) V,A = —logyy) k, B= -—— 
Y Y 


“. The normal equations are 


LY =6A + BIX (i) 
XXY = ALYX + BIX? (ii) 
Now 2X etc. are calculated as follows: 
p V X=log,,p | Y=log,,V XY xe 

0.5 1.62 —0.3010 0.2095 —0.0630 0.0906 
1.0 1.00 0.0000 0.0000 —0.0000 0.0000 
1.5 0.75 0.1761 —0.1249 —0.0220 0.0310 
2.0 0.62 0.3010 —0.2076 —0.0625 0.0906 
2.5 0.52 0.3979 —0.2840 —0.1130 0.1583 
3.0 0.46 0.4771 —0.3372 —0.1609 0.2276 
Total 1.0511 — 0.7442 — 0.4214 0.5981 


.. Equations (i) and (ii) become 
6A + 1.0511B =— 0.7442; 1.0511A + 0.5981B =— 0.4214 
Solving these, we get A = 0.0132, B =— 0.7836. 
y=-V/B=1.276 
and k = antilog (Ay) = antilog (0.0168) = 1.039. 
Hence the equation of best fit is pV1.276 = 1.039. 


5.8 Most Plausible Values of Unknowns 


Consider m linear equations in n unknowns: 


Ay X1 + y9X_ +...4,,xX, = ky 


AygX1 + Aggy +..-Xa_Xq_ = ky (1) 


AMX, + AMgX%y +... Ginn Xn =K 


man 
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When m =n, we can find a set of values of the unknowns uniquely. 


When m > n, i.e., the number of equations is greater than the number 
of unknowns, it may not be possible to find these values uniquely. Then we 
find those values of x,, x,,...n which satisfy (1) as nearly as possible. Apply- 
ing the principle of least squares, these values 

can be obtained by minimizing E = Sian + djoXy +... Gi,X, —k;)” 

x=] 
using the conditions of minima, i.e., 


we get n equations. Solving these equations, we get most plausible val- 
WES Of Bj X10 %,. 


n 


EXAMPLE 5.15 


Find the most plausible values of x, y, and z from the equations x — 3y 
—32=-14, dv t+y +4 =21, 3x + Qy —5z =5 and x —y + 22 =3, by forming 
the normal equations. 


Solution: 
Let E = (x — 8y — 3z + 14)? + (4x + y + 4z — 21)? 
+ (3x + 2y — 5z -5)? + (x-y + 22-3)? 
The most plausible values of x, y, z will be those which make E mini- 
mum. These will be given by 


JE 
“3 = Bla — By — Sz +14) + 2An + y + de —21)4 + (3x + 2y — 5z— 5)8 (i) 
xX 


+2 (x-y+t 2z- 3) = Vie,27x+ 6y= 88 


don OE 
Similarly roi 0 gives 6x + 15y +z=70 
y 
OE 
and i. 0 gives y + 54z = 107 
¥6 


Solving (i), (ii), and (iti) we get the desired values « = 2.47, y = 3.55, 
z=1.92. 
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Exercises 5.3 


1. If V (km/hr) and R(kg/ton) are related by a relation of the type R = a + 
bV’, find by the method of least squares a and b with the help of the fol- 
lowing table: 


V= 10 20 30 40 50 
R= 8 10 15 21 30 
2. Using the method of least squares fit the curve y = ax + bx* to following 
observations: 
X: 1 2 3 4 5 
y: 1.8 ap 8.9 14.1 19.8 
3. Fit the curve y = ax + b/x to the following data: 
x 1 2 3 4 5 6 7 8 
y: 5.4 6.3 8.2 10.3 12.6 14.9 17.3 19.5 


4. Estimate y at x = 2.25 by fitting the indifference curve of the form 
xy = Ax + B to the following data: 


e 1 2 3 4 
y: 3 is | 6 | 75 
5. Fit a least square geometric curve y = ax’ to the following data: 
x: 1 2 3 4 5 
y. | 05 2 45 8 | 125 


6. Predict y at x = 3.75, by fitting a power curve y = ax’ to the given data: 
x: 1 2 3 4 5 6 
y: 2.98 4.26 5.21 6.10 6.80 7.50 


7. Obtain a relation of the form y = kx” for the following data by the 
method of least squares: 


a: 1 2 3 4 5 
y: 7.1 27.8 62.1 110 161 
8. Fit the exponential curve y = ae’ to the following data: 
a: 2 4 6 8 
y: 2 | 38 | 56 | 84 


9. Fit the curve of the form y = ae” to the following data: 


x: 77 100 185 239 285 
y: 2.4 3.4 7.0 11.1 19.6 
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10. Growth of bacteria (N) in a culture after ¢ hrs. is given in the following 


table: 
t: 0) 1 2 3 4 5 6 
N: 32 47 65 92 132 190 275 


Fit a curve of the form N = ab! and estimate N when t = 7. 


11. The voltage v across a capacitor at time t seconds is given by the follow- 


ing table: 

t: 0 2 4 6 8 

U: 15 0 63 28 12. 5.6 
Use the method of least squares to fit a curve of the form v = aekt to this 
data. 


12. Obtain the least square fit of the form f(t) = ae + be™ for the data: 


xX: 0.1 0.2 0.3 0.4 
fit): 0.76 0.58 0.44 0.35 


13. Find the most plausible values of x and y from the equations x + 3y = 
7.03, x + y = 3.01, 2x — y = 0.03, 3x + y = 4.97, by forming the normal 


equations. 


14. Obtain the most plausible values of x, y and z from the equations: 
xt+2yt+z=l-xt+y+2z%=3, Wty+z=4, 40+ Qy-5z=-7 


5.9 Method of Group Averages 


Let the straight line y = a + bx (1) 
fit the set of n observations (x,, y,), (x, y,), --.. (x, y,,) quite closely. 
(Figure 5.5). 
Pi(Xn, Yn) 
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When x = x,, the observed (or experimental) value of y = y,= L,P, 
and from (1), y = a + bx,= L,M,, which is known as the expected (or 
calculated) value of y at L,. 
Then e, = observed value at L, -expected value at L, 
=y,-(at+bx,)=MP,, 
which is called the error (or residual) at x,. Similarly the errors for the 
other observations are 


oie Y,— (a + bx,) = M P 


nn 


Some of these errors may be positive and others negative. 


The method of group averages is based on the assumption that the sum 
of the residuals is zero. To find the constants a and b in (1), we require two 
equations. As such we divide the data into two groups: the first containing 
k observations (x,, y,), (x, y,)-+» (x, y,); and the second group having the 
remaining n — k observations (x,,,5 Yz,1)> piso Yeag)>e* 29 Xye Yi)» 

Assuming that the sum of the errors in each group is zero, we get 

{y,— (a + bx,)} + {y,- (a+ bx,)} +... + lyk - (a + bx,)} =0 

{y,,,— (a + bx,,,)} + {y,,.—- (a+ bx,,,)} +... + {yn - (a+ bx, )} =0 


On simplification, we obtain 


Yy FY +...Y ey es 


k k 
Yaoi tYK+a T+-Yn Lge poe FXqp9 TIN 
n—-k n—-k 


1 1 
In (2), rs Pity dese. van ra + yy +...+Yy,) are simply the aver- 


age values of x’s and y’s of the first group. Hence the equations (2) and (3) 
are obtained from (1) by replacing x and y by their respective averages of 
the two groups. Solving (2) and (3), we get a and b. 


NOTE Obs. The main drawback of this method is that a different 
grouping of the observations will give different values of a and 
b. In practice, we divide the data in such a way that each group 
contains almost an equal number of observations. 
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EXAMPLE 5.16 


The latent heat of vaporization of steam r, is given in the following table 
at different temperatures t: 


t: 40 50 60 70 80 90 100 110 
r: 1069.1 | 1063.6 | 1058.2 | 1052.7 | 1049.3 | 1041.8 | 1036. | 1030.8 


For this range of temperature, a relation of the form r =a + bt is known 
to fit the data. Find the values of a and b by the method of group averages. 


Solution: 


Let us divide the data into two groups each containing four readings. 
Then we have 


t r t r 
40 1069.1 80 1049.3 
50 1063.6 90 1041.8 
60 1058.2 100 1036.3 
70 1052.7 110 1030.8 
Xt = 220 =r = 4243.6 Xt = 380 =r = 4158.2 


Substituting the averages of t’s and 1’s of the two groups in the given 
relation, we get 


4243.6 220 
=atb— ie. 1060.9=a+55b (i) 


aDOE gp?” e7 1osgbeasuun (ii) 


4 + 


Solving (i) and (ii), we obtain 
a= 1090.26, b =— 0.534. 


EXAMPLE 5.17 


The observations in the following table fit a law of the form y = ax". 
Estimate a and n by the method of group averages. 


x? 10 20 30 40 50 60 70 80 
Y: 1.06 1.33 1.52 1.68 1.81 1.91 2.01 2.11 
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Solution: 
We have y=a™ 
Taking logarithms, log,, y = log,, a +n log,, x 
i.e. Y=A+nX (i) 
where X=log,,x, Y =log,,y, A =log,, a 
Divide the data into two groups each containing four pairs of values, 
so that 
x Yy = log,, x Y= log, , Y 
10 1.06 1.0253 0.0253 
20 1.83 1.3010 0.1238 
30 1.52 LA771 0.1818 
40 1.68 1.6021 0.2253 
XX = 5.4055 XY = 0.5562 
50 1.81 1.6990 0.2577 
60 1.91 1.7782 0.2810 
70 2.01 1.8451 0.3032 
80 20h 1.9031 0.3243 
LX = 7.2254 XY = 1.1662 


Substituting the averages of X’s and Y’s of the two groups in (i), we get 


peo? =A+n Babe ie., 0.13890 = A+1.3514n 

4 4 (ii) 
11662 7.2254 
3 Fi ie., 0.2916 = A+1.8064n (iit) 


(iii) — (ii) gives 0.1526 = 0.455 n i.e., n = 0.3354 
From (ii), A = — 0.3142 i.e., log10 a =— 0.3142 
where a = antilog ( — 0.3142) = 0.4851 


5.10 Laws Containing Three Constants 


We have so far applied the above method to fit the data to laws involv- 
ing two constants only. But at times we come across laws of the form 


y=atbx+cex,y=atbx and y=atbe* 
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each of which contains three constants. To fit such laws to a set of observa- 
tions, we devise the following procedures to reduce these to laws previously 
discussed. 


(1) Equation y = a + bx + cx? 
Let (x,, y,) be a point on the curve satisfying the given data so that 


y, =atbx, +cx; 


Then y—y, =b(x- x) +(x” — 2x7) 
—yl 
or LF <b 4+ olx+x,) 
x=cl, 


Putting x + x, = X and (y -— y,)(x — x,) = Y, it takes the linear form 
Y=b+cxX. 


Now b and c can be found by the graphical method or the method of 
averages. 


(2) Equation y = a + bx® 
It can be rewritten as y — a = bx* (1) 


To find a, let (x,, y,), (x, y,), (ts, y,) be three particular points on the 


3 
curve (1) such that x,, x,, x, are in geometric progression 
2 
Lé., mg SB (2) 
— c 
Then yy ~ a = bx; 


Yo — a= bx 


and Yy3 —a = bxs 
(y, — a)(y3 — a) = b?(x,x3)° = b? (x3) [by (2)] 
= (bx5)" = (yx — ay 
or aly, + ys —2Y2) = Y1Ys — Yo 


which gives a. Now (1) reduces to a law containing two constants b and c 
only. 


Taking logarithms, (1) becomes 

log,,(y —@) =log,,b + log,,x 
or Y=B+cX (3) 
where X = log,, x, Y = log,, (y —a), B = log,, b. 
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Hence we can find b andc as before from (3). 

(3) Equation y = a + be* 

It can be written as y — a = be* (1) 
To find a, let (x,, y,), (x, y,), (ty) be three particular points on the 


curve (1) such that x,, x,, x,are in arithmetic progression 


i.e., x,+x,= 2x, (2) 
Then y, ~a=be™, yo-a=be™ and y3;-a=be™ 
(y, -a) (y3 -a) = pes = (be? a = (Yo = ay 
or aly, +y3 — 2y2) = yrys — Yo" 
which gives a. Now (1) reduces to a law containing two constants b and 
c only. 


Taking logarithms, (1) becomes 
log, (y -— a) =log,, b + cx log,, e 
or Y=B+Cx (3) 
where Y=log,, (y—a), B=log,,b, C =c log, e. 


Hence we can find b and c as before from (3). 


EXAMPLE 5.18 


The corresponding values of x and y are given by the following table: 


x: | 87.5 84.0 77.8 63.7 46.7 36.9 
Yy: 292 283 270 235 197 181 


Fit a parabola of the form y = a + bx + cx’, by the method of group 
averages. 


Solution: 


Taking x = 84, y = 283 as a particular point on y = a + bx + cx”, we get 


283 =a + b(84) + c(84)? (i) 
y — 283 = b(x — 84) + c[x? — (84)?] 
— 283 
or J =b+c(x+84) i.e. Y=b+cx (ii) 
x — 84 


where X =x + 84, Y = (y — 283)/(x — 84). 
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Now we have the following table of values: 


x y X=x+84 Y = (y — 283)/(x - 84) 
87.5 299 1715 2.571 
84.0 283 = = 
778 270 161.8 2,097 
EX = 333.3 LY = 4.668 
63.7 235 147.7 2,364 
46.7 197 130.7 2.306 
36.9 181 120.9 2.166 
EX = 399.3 LY = 6.836 


Substituting the averages of X and Y in (ii), we get 


— =bt+c ae ie. 2.33 = b + 166.65 ¢ (iii) 
6.836 399.3 
i ee ie.2.28=b+13l.1c (iv) 


(iv) — (iti) gives c = 0.0014 

and (iii) gives b = 2.0967 i.e., 2.1 nearly 

From (i), we get a = 96.9988 i.e., 97 nearly. 

Hence the parabola of fit is y = 97 + 2.1x + 0.0014? 


EXAMPLE 5.19 


The train resistance R (Ibs/ton) is measured for the following values of 
its velocity V (km/hr): 


V: 20 40 60 80 100 
R: 5 9 14 25 36 


If R is related to V by the formula R =a + bV’, find a, b, and n. 


Solution: 

To find a, we take the following three values of v which are in G.P.: 
v, = 20, v, = 40, v, = 80 

Then R,=5, R,=9, R,=25 
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(R, —a)(R, — a) = (R, - a)? 
R,R; —R,° 
= —_._—_ = 3.67 
where @ R, +R, —2R, 


Thus R - 3.67 = bV" or log, (R — 3.67) = log, b +n log, V 
Y=k+nx (i) 
where X = log,, V, Y = log,, (R — 3.67), k = log, b. 


Now we have the following table of values: 


V R X=log,, V Y =log,, (R - 3.67) 
20 5 1.3010 0.1238 
40 9 1.602 1 0.7267 
60 14 1.7782 1.0141 
XX = 4.6813 XY = 1.8646 
80 25 1.9031 1.3290 
100 36 2.0000 1.5096 
XX = 3.9031 LY = 2.8386 


Substituting the averages of X’s and Y’s in (1), we obtain 


1.8646 4.6813 
=k+n 


ie. 0.6215 = k + 1.5604n (ii) 


4 


2.8386 3.9031 
, =k+n 5 ie. 1.4193 = k + 1.9516n (iii) 


Solving (ii) and (iii), we get n = 2.04, k = — 2.56 approx. 
b = antilog k = antilog (— 2.56) = 0.0028. 


Exercises 5.4 


1. Fit a straight line of the form y = a + bx to the following data by the 
method of group averages: 

aCe 0 5 10 15 20 95 

y: 12 15 17 22, 24 30 


2. Apply the method of group averages to work out Example 4.13. 
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3. The weights of a calf taken at weekly intervals are given below: 


Age: 1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


Weight: 52.5 


58.7 


65.0 


70.2 


75.4 


81.1 


8 


7.2 


95.5 


102.2 


108.4 


Find a straight line of best fit. 


4. Work out Example 5.1, by the method of group averages. 


5. The head of water H (ft) and the quantity of water Q(ft*) flowing per 
second are related by the law Q = CH". Find the best values of C and n 
by the method of group averages for the following data: 


H: 1.2 1.4 1.6 1.8 2.0 2.4 
Q: 4.2 6.1 8.5 11.5 14.9 23.5. 
6. Using the method of averages, fit a parabola y = ax2 + bx +c to the fol- 
lowing data: 
X: 20 40 60 80 100 120 
y: 5.5 9.1 14.9 22.8 33.8 46.0 


7. While testing a centrifugal pump, the following data is obtained. It is 
assumed to fit the equation y = a + bx + cx’, where x is the discharge in 
liter/sec and y, head in meter of water. Find the values of the constants 
a, b, c by the method of group averages. 


X: 2 2.5 3 3.5 4 4.5 5 BHD) 6 
y: 18 17.8 17.5 17 15.8 14.8 13.3 11.7 9 
8. By the method of averages, fit a curve of the form y = ae’ to the follow- 
ing data: 
X: 5 15 20 30 35 40 
y: 10 14 25 40 50 62 


9. In an experiment, the voltage v is observed for the following values of 


the current i: 


i: 


0.5 


1 


2 


4 


8 


12 


10 


160 


120 


94 


75 


62 


56 


If v and i are connected by the relation v = a + bi‘, find a, b, and k. 


10. The variables s and t are connected by the relation s = a + be” and their 
corresponding values are given in the following table: 


Find the best possible values of a, b, and n. 


EE: 


1 


2 


6 


8 


Jil 


Ss: 


12.7 


12.5 


11.6 


11.3 


11 
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5.11 Method of Moments 


Let (x,, y,), (X,, y,), +++ (x, y,,) be the set of n observations such that 


on? 


x 


9% HXy XS XOX h (say) 

We define the moments of the observed values of y as follows: 

m,, the Ist moment = hZy 

m,, the 2nd moment = hXxy 

m,, the third moment = h&x*y and so on. 

Let the curve fitting the given data be y =f(x). Then the moments of the 
calculated values of y are 

,, the 1st moment = J ydx 

,, the 2nd moment = i xy dx 

,, the 3rd moment = J x°y dx and so on. 

This method is based on the assumption that the moments of the ob- 
served values of v are respectively equal to the moments of the calculated 
values of y, i.e.,m, =,,m, =,, mM, =, etc. These equations (known as 
observation equations) are used to determine the constants in f(x). 

m’s are calculated from the tabulated values of x and y while ’s are 
computed as follows: 


In Figure 5.6, y, the ordinate of P (x =x,), can be taken as the value of y 
at the mid-point of the interval (x — h/2, x, + h/2). Similarly y,, the ordinate 
of P (x =x,), can be taken as the value of y at the mid-point of the interval 
(x, —h/2, x, + h/2). If A and B be the points such that 


OA =x, —h/2 and OB =x, + h/2, 


then yw, =fyde=f f (x)dxa 


x, —h/2 


x,h/2 


x, th/2 x,th/2 . 
Ms =f xf (x)dx M3 =f x f (x) and so on. 


xy =h/2 x —h/2 
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FIGURE 5.6 
EXAMPLE 5.20 
Fit a straight line y =a + bx to the following data by the method of mo- 
ments: 
x: 1 2 3 4 
y: 16 19 23 26 
Solution: 


Since only two constants a and b are to be found, it is sufficient to cal- 
culate the first two moments in each case. Here h = 1. 

m, =hXy = 1(16+ 19 + 23 + 26) = 84 

m, = hixy = 1(1 x 164+2x19+3 x 22+4 x 26) = 227. 

To compute the moments of calculated values of y = a + bx, the limits 
of integration will be 1 —h/2 and 4 + h/2, i.e., 0.5 and 4.5. 
45 


2 


ax +b 
2 


4.5 
maf (a+ bx)dx = =4a+10b 


).5 


05 
45 91 
My = le x(a + bx)dx = 10a + Pa 
Thus, the observation equations mr = yr (r= 1, 2) are 
91 
4a+10b=84; 10a+ me = 297 


Solving these, a = 13.02 and b = 3.19. 
Hence the required equation is y = 13.02 + 3.19x. 


230 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


EXAMPLE 5.21 


Given the following data: 


ae 0 1 2 3 4 
y: 1 5 10 22 38 
find the parabola of best fit by the method of moments. 
Solution: 
Let the parabola of best fit be y = a + bx + cx? (i) 


Since three constants are to be found, we calculate the first three mo- 
ments in each case. Here h = 1. 


m, =hZy =1(1+5+ 10+ 22 + 38) = 76 
mM, = hxy = 1(0+ 5 + 20 + 66 + 152) = 243 
mM, = hXx2y = 1(0 + 5 + 40 + 198 + 608) = 851 
For computing the moments of calculated values of (i), the limits of 


integration will be 0 —h/2 and 4 + h/2, i.e., — 0.5 and 4.5. 


My = fo (a+ bx + cx )dx =5a+10b +30.4c 
My = i x(a + bx + cx” dx = 10a + 30.4b + 102.5 
M3 = fi 2a + bx + cx* dx = 30.4a + 102.5b + 369.1c 
Thus the observation equations mr = 1, (r= 1, 2, 3) are 
5a + 10b + 30.4c = 76 
10a + 30.4b + 102.5c = 243 
30.4a + 102.5b + 369.1c = 851 
Solving these equations, we get a = 0.4, b = 3.15, c = 1.4. 
Hence the parabola of best fit is y = 0.4 + 3.15x + 1.4x°. 


Exercises 5.5 


1. Use the method of moments to fit the straight line y =a + bx to the data: 
x: 1 2 3 4 
y: 0.17 0.18 0.23 0.32 
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2. Fit a straight line to the following data, using the method of moments: 


x: 1 3 oD 7 9 
y: 1.5 2.8 4.0 4.7 6.0 


3. Fit a parabola of the form y =a + bx + cx*to the data: 
2 1 2 3 4 
y: 1.7 1.8 2.3 3.2 


by the method of moments. 


4. By using the method of moments, fit a parabola to the following data: 


x: 1 2 3 + 
y: 0.30 | 0.64 1.32 5.40 


5.12 Objective Type of Questions 


Exercises 5.6 


Select the correct answer or fill up the blanks in the following questions: 


1. The method of group averages is based on the assumption that the sum 
of the residuals is... 


2. y =ax’ +c in linear form is..... 

3. To fit the straight line y = mx + c to n observations, the normal equations 
are 

(i) Ly =nXx + Lem, Ixy =c Ix? + cIn. 
(ii) Ly = mXx + ne, Uxy = mXx*+ cXx. 
(iii) Ly = cLx + mIn, Lxy = cx? + mXx. 

4. To fit y = ab* by least square method, normal equations are... 


5. The observation equations for fitting a straight line by method of 
moments are... 


6. The principle of ‘least squares’ states that... 


7. y =ax’ + b log, x reduced to linear law takes the form.... 
0 Ll 


0 11 | then the straight line of best fit is... 


x: 
8. Given 
us 


232 « 


14. 


15. 


16. 
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. The method of moments is based on the assumption that.... 


-Iny=a+bx, Xx =50, Ly = 80, Xxy = 1030, Xx? = 750, and n = 10, then 


Oy D Sexes 


. The gas equation pur =k can be reduced to y =a + bx where a=... 


in linear form is... 


ax +b 


. Ify =ke™, then the first normal equation is Llog,, y =... 


(a) kn +m =x (b) kXx + m=Xx2 
(c) n log, k +m log, eXx (d) kZlog .y +mxXx. 
If y=a+bx +cx? and 


Xi 0 1 2 3 4 
y: 1 1.8 1.3 2.5 7.3 


then the first normal equation is 
(a) 15 =5a + 10b + 29c (b) 15 =5a+ 10b + 31c 


(c) 12.9=5a+ 10b + 30c (d) 34 =5a+ 10b + 27c. 
If y = 2x +5 is the best fit for 8 pairs of values of (x, y) by the method of 
least squares, and Ly = 120, then Xx =... 

(a) 35 (b) 40 

(c) 45 (d) 30. 
If y =a + bx’ and n is the number of observations, then the first normal 


equations is Ly =... 
(a) na + bXx? (b) na Xx + bXx? 


(c) na + b=x? (d) na Xy + bXyx?. 
Y Y 
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Objective type of questions 


6.1. Introduction 


The calculus of finite differences deals with the changes that 
take place in the value of the function (dependent variable), due to 
finite changes in the independent variable. Through this, we also 
study the relations that exist between the values assumed by the 
function, whenever the independent variable changes by finite 
jumps whether equal or unequal. On the other hand, in infinitesi- 
mal calculus, we study those changes of the function which occur 
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when the independent variable changes continuously in a given interval. In 
this chapter, we shall study the variations in the function when the indepen- 
dent variable changes by equal intervals. 


6.2 Finite Differences 


Suppose that the function y = f(x) is tabulated for the equally spaced 
values x =x,, Xx, +h, x, + 2h,...x,+nh giving y = y,,y,y,°*y,-10 determine 
the values of f(x) or f’(x) for some intermediate values of x, the following 
three types of differences are found useful: 


Forward differences. The differences y, — y,, y, — y,.--. y,, — y,_ when 
denoted by Ay,, Ay,,---, Ay, _, respectively are called the first forward dif- 
ferences where A is the forward difference operator. Thus the first forward 
differences are Ay =y_.,-y,- 


Similarly these second forward differences are defined by A’y, = 
Ay... > Ay r 

In general, A’y = A’'y , — A’'y defines the pth forward differences. 
These differences are systematically set out in Table 6.1. 

In a difference table, x is called the argument and y the function or the 
entry. y,, the first entry, is called the leading term and Ay,, A’y,,A*y, etc. are 
called the leading differences. 


TABLE 6.1 Forward Difference Table 


Value of x | Value of y| 1st diff. | 2nd diff. | 3rd diff. | 4th diff. | Sth diff. 
At 0 
i yy A*y, 
Ay, A’, 
x, + 2h Y> A’y, A*y, 
Ay, A’y, A’y, 
x, + 3h Ys A’y, A‘y, 
Ay, A’y, 
x,+4h Y, A’y, 
At , 
x, +5h Ys 
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Obs. 1. Any higher order forward difference can be expressed 
in terms of the entries. 
We have Dy, = Dy 1 Dy, =(Y, i y) =U, = =Y,— 24, + Y, 
A*y, = A’y, — A’y, = (y, - 2y,+y,) i (y, — 24, + Yo) 
=Y,— Sy, + 3y, — Yo 
Aly0 = Ary, — A’y, 
= (yy — 3Yy, + 345 — Yy) — (Ys — SY, + 8Yy, — Yo) 
=y,— 4y, + Gy, — 4y, + yy 
The coefficients occurring on the right-hand side being the 
binomial coefficients, we have in general, 
A"y,= Y,, ~ "C, Yn + "C, Y n-2 0° + ( i Bi Yo. 


NOTE 


Obs.2.The operator A obeys the distributive, commutative, and 
index laws 
i.e, (i) Alf(x)+ = Af(x)+ Ap(x) 
Alefix)] = an x),c being a constant. 


(iit) Am An fix) = Am +n f(x), m and n being positive integers. In 
view of (i) and ne A is a linear operator. 


But A[f(x) fx) 
Backward ae 7 i G24 GAY, Hy, wen 
denoted by Vy,, Vy,,---, Vy, respectively, are called the first backward dif- 
ferences where A 
TABLE 6.2 Backward Difference Table 


Value of x |Value of y| 1st diff. | 2nd diff. | 3rd diff. | 4th diff. | 5th diff. 
Xo Yo 
Vy, 
ae yy V’y, 
Vy, V’y; 
tik 2h Y> V°y, V’y, 
Vy V’y, V’y. 
x, + 3h Ys Vy, Vu 
Ay, V’y. 
x, + 4h Y, V'y. 
VY 
x, + 5h Ys 
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is the backward difference operator. Similarly we define higher order 
backward differences. Thus we have Vy, = y,—y,_,, V’y, = Vy, — Vy,_ | 
V*y,. = V*y, - Vv’. pete 

These differences are exhibited in the Table 6.2. 
Central differences. Sometimes it is convenient to employ another sys- 
tem of differences known as central differences. In this system, the central 
difference operator O is defined by the relations: 


Yi Yo =OY 95 Y,-Y, = OY x0» YU Yan 2) ae 
Similarly, higher order central differences are defined as 
OY 50 = OW 7 O°y,, OY 5,» 0% 3/2 O°y 2" OY, = Oy, = O°Y 55 and so on. 
These differences are shown in Table 6.3. 


TABLE 6.3 Central Difference Table 


Value of x | Value of y| Ist diff. | 2nd diff. | 3rd diff. | 4th diff. | Sth diff. 
Xy Yo 
ot 1/2 
xh Y, 0’y, 
on 3/2 0° 3/2 
x, + 2h Y, O’y, o'y 
OY 5/0 OY 5,5 OY ss 
x, + 3h Ys O's OY 
OY 
x, +4h Y, Oy, OY on 
OY oy. 
xX) + 5h Ys 


We see from this table that the central differences on the same horizon- 
tal line have the same suffix. Also the differences of odd order are known 
only for half values of the suffix and those of even order for only integral 
values of the suffix. 


It is often required to find the mean of adjacent values in the same col- 
umn of differences. We denote this mean by yw. 


1 . ie. on 
Thus pdy, = (yo + OY3/2), HO Yaa = 5 (O's + 6°ya), ete. 


Obs. The reader should note that it is only the notation which 
NOTE ; 
changes and not the differences. e.g. 
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Y — Y= Vy, = Ay, = dy 1/2" 


Of all the formulae, those involving central differences are most 
useful in practice as the coefficients in such formulae decrease 
much more rapidly. 


EXAMPLE 6.1 
Evaluate (i) Atan"'x (ii) A(e‘log 2x) (iii) A(x?/cos 2x) (iv) A("C,, ,). 
Solution: 
(i) Atan x = tan7!(x +h) —tan lx 


tan! anil tan | t 
= tal —i——————Pp ot ———— 
l+(xth)x lthx+x? 


(ii) A(e* log 2x) = gon log 2 (x +h) -e* log 2x 
=e" Jog? (x +h)—e**" log 2x + e**" log 2x — e* log 2x 


ath xth 


=¢"*" log —(e**™" —e* log 2x 
x 


=e et log + *) + (c! = 1)log2| 
% 


(iii) a x |- (x +h) a 


cos2x 


. cos2(x+h) cos2x 
(x +h)? cos2x — x? cos 2(x +h) 
cos 2(x + h)cos 2x 
[( +h) - ° |eos2x +x" [cos 2x —cos2(x+h)] 
cos 2(x + h)cos 2x 
(2hx +h?) cos 2x + 2x” sin(h)sin(2x +h) 
cos 2(x + h)cos 2x 


(iv) AC.) =""* Chay —” Chay 
(n+1)! a (n)! 
“(r+)in-n)! (r+))!\(n—r-D! 
_ (n)! (1) 
“(rt Din—-r—-D! \n—r 
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_ (n)! ae) a 
“(r+ )in—-r—-D!i(n—r) ril(n—-r)! 


Cy 


EXAMPLE 6.2 


5x+12 
x’ +5x+16 
(iti) A?(ab™) (iv) A"(e*) 
Interval of differencing being unity 


Evaluate (i) A’ (ii) A?cos 2x 


Solution: 


(a4 5x +12 |na? 5a +1 =a} a 3 
x2+5x +16 (x +2)(«+3) x+2 “x48 
=ata(a}+4()] 
x+2 x+3 
a 
x+3 x42 x+4 x48 


aes} aera} 
2)(x +3) (x +3)(x +4) 


4 6 
~ (x + 2)(x +3)(x +4) 7 (x +3)(x+4)(x +5) 
2(5x + 16) 


(x + 2)(x + 3)(x + 4)(x + 5) 
(ii) A? cos2x = A{cos2(x + h) — cos2x} 
= Acos2(x + h) — Acos2x 
= [cos2(x + 2h) — cos2(x + h)] — [cos2(x + h) — cos2x] 
= — Y2sin(2x + 3h)sinh + 2sin(2x + h)sinh 


= — 2sinh[sin(2x + 3h) — sin(2x + h)] 
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= — 2sinh[2cos(2x + 2h)sinh] =— 4sin*hcos(2x + 2h). 
(iii) = Al(ab*) = aA(b*) = albe**) — b@] = ab(be — 1) 
A?(ab*) = A[A(ab™)] = a(b¢ — 1)A(b) 
= a(be — 1) (b+? — b*) =albe — 1)°b* 


(iv) Koa ae = (e-l)e 
Ave = A(Ae’) = Al(e- le] 
=(e-1)Ae =(e-1)(e-le =(e- ne 
Similarly Ae = (e- eke =(e- ie. 
and Ate* = (e — 1)"e*. 
EXAMPLE 6.3 


If y = a(3)* + b(— 2)* and h = 1, prove that (A? + A — 6)y = 0. 
Solution: 
We have y = a(3) + b( — 2)" 
Ay = [a(3)** + b( — 2)*"] — [a8 + b( - 2) 
= 2a(3)*-— 3b( - 2)" 
and A’y = [2a(3)**! — 3b( — 2)**"] — [2a(3)" — 3b( — 2)"] 
= 4a(3)* + 9b( — 2) 


EXAMPLE 6.4 


Find the missing y, values from the first differences provided: 


VE 
Ay 0) 1 


x 


bo 
aw 
~l 


11 


Solution: 


Let the missing values be y,, y,, YY, Ys. Then we have 


Y, 0 Y, Yo Ys Y4 Ys 
Ay 0 1 2 4 i 11 


x 
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gE Lge 2 ee eG 
L.e., Gly R 27H 38.4 H 27 y= Y= = 
y,=11+y,= 25. 


6.3 Differences of A Polynomial 


The nth differences of a polynomial of the nth degree are constant and 
all higher order differences are zero. 


Let the polynomial of the nth degree in x, be 
f(x) Sax" + bx®-1 + ex®-?2 + 5.-+kxe tl 
Afix) =flx + h) = fix) 
=al(xth)"-x"] +bl(xth)-t-a"-t]4---+kh 
=anhx"~ 1+ b’x 24+ cx" 34 +. +khe sl (1) 
where b’, c’, ---,l’ are the new constant co-efficients. 
Thus the first differences of a polynomial of the nth degree 
is a polynomial of degree (n — 1). 
Similarly 
A’f(x) = Alfa + h) — flx)] = Aftx + h) — Af(x) 
=anh| (x +h)y"-!-ax"-"]+b (x + hy-2-x" 2] 4+. +khh 
=an(n — 1)h?x"-2 + bx" 3 + Ce tt ee ERY by(1) 
*. The second differences represent a polynomial of degree 
(n — 2) 
Continuing this process, for the nth differences we get a 
polynomial of degree zero i.e. 
A'f(x) = an(n—1)(n —2)...1.4° = an Sh" (2) 
which is a constant. Hence the (7 + 1)th and higher differences of a 
polynomial of nth degree 


will be zero. 


Obs. The converse of this theorem is also true, i.e., if the nth 
differences of a function tabulated at equally spaced intervals 
are constant, the function is a polynomial of degree n. This 


NOTE 
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fact is important in numeric alanalysis as it enables us to 
approximate a function by a polynomial of nth degree, if it s nth 
order differences become nearly constant. 


EXAMPLE 6.5 
Evaluate A[(1 — ax)(1 — bx?)(1 - ex?)(1 - ex3)(1 - dx*)]. 
Solution: 
AI (1 — ax)(1 — bx?)(1 — ex3)(1 — dx*)] = AM [abcdx" + (x? + (x8 +... + 1] 
= abcd A'(x!) [.. AM(x") = 0 for n<10] 
= abcd(10!) [by(2 above ] 


Exercises 6.1 


1. Write forward difference table if 


Xx: 10 20 30 40 
y: Ll 2.0 4.4 7.9 
2. Construct the table of differences for the data below: 
x: 0 1 2 3 4 
f(x): 1.0 15 2.2, 3.1 4.6 
Evaluate A*f(2). 


3. Ifu, =3, u, = 12,u, = 81,u, = 2000, uw, = 100, calculate A‘u,. 
4. Show that Ay, = 43 ae 3Y;.5 a 3Y; 1 = yt. 


5. Ify =x° +x” — 2x + Levaluate the values of y for x = 0,1, 2, 3, 4, 5 from 
the difference table. Find the value of y at x = 6 by extending the table 
and verify that same value is obtained by substitution. 


6. Form a table of differences for the function f(x) =x° + 5x — 7 for 
x=- 1,0, 1, 2,3, 4, 5. 
Continue the table to obtain f(6). 


7. Extend the following table to two more terms on either side by con- 
structing the difference table: 

x: —0.2 0.0 0.2 0.4 0.6 0.8 1.0 
y: 2.6 3.0 3.4 4.28 7.08 14.2 29.0. 
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8. Show that 
i Be =Af(x) = Se Af (x) 
0 alr papery Als sedmtegli+F7} 
9. Evaluate (taking interval of differencing as unity) 
(i) A(x + cosx) (i) Ata ("—] 
n 
(itt) A (e™log2x) (iv)A(2'/x!) 
10. Evaluate: 
(i) A’cos 3x li) x2 ( ees 
x +5x+6 
(iti) An(e?**°) (iv) A" ( i 
x 


(v) A"sin (ax + b) 


11. Iffx)=e" ie show that its leading differences form a geometric 
progression 
12. Prove that 
(i) ys = Yo t Ay, + A’y, + Ay, Gi)A’y = yg 24, + Yo 
7? ne 
(iii) 6 vey, 2y. ty, 
13. Evaluate: 
(i)A*[(1 —x)(1 - 2x)(1 - 3x)(1 - 4x)],(h = 1). 
(ii )AM[(1 —x)(1 — 2x?)(1 — 3x3)(1 — 4x*)], ifthe interval of differencing is 2. 


6.3. Factorial Notation 


A product of the form x(x — 1)(x — 2)---(x — r+ 1) is denoted by [x]” and 
is called a factorial. 


In particular [x] = x,[x]? = x(x — 1),[x]° = x(x - 1)(x - 2),ete. 
In general [x]" = x(x — 1)(x — 2)... —n +1) 


Iftheinterval of differencingish, then [x]" = x(x —h)(x — 2h)---(x—n — Ih) 
which is called a factorial polynomial or function of degree n. 
The factorial notation is of special utility in the theory of finite differ- 


ences. It helps in finding the successive differences of a polynomial directly 
by simple rule of differentiation. 
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To show that An|x]n =n! and An + 1[x]n =0 
We have 
All =[x-+np [xt 
=(x+h)(x+h—h)(x+h—2h)---(x +h—n—Ih) 
—x(x —h)(x —2h)---(x —n—Ih) 
=x(x—h)---(x—n—2h)[x +h —(x—nh +h)] 
= nh{x}" 
Similarly A?[x]" = A{nh[x]"~"} = nhA[x]"~! 
Replacing n by n — 1 in (i), 
we get A’[x]" =nh.(n — I)h[x]"-? = n(n — 1I)h*[x]"-? 
Proceeding in this way, we obtain A"~![x]" = n(n — 1)---2h"~!x 
A'[x]" = n(n — 1)---2:h"- Ax 
=n(n—1)---21A"- "(x +h—-x) 
=nth" (ii) 
Also A®*}[x]? =nlh" -— nth" =0 
In particular, when h = 1,we have 
A{x}" =n[x]""! and A’[x]" =n! (iti) 
Similarly A’[ax + b]" =n(n —1)---(n-r+ l)ah'lax + b]"~" 
Thus we have an important result: 
A{x}" = n[x]"~!; Afax + b]" = an[ax + b]"-! (iv) 
i.e., the result of differencing [x]n is analogous to that of differentiating 


x", 
NOTE Obs.1. As it is easier to find Ax[x]n than Ar xn, xn must always 
be expressed as a factorial polynomial before finding Ax. 
Obs.2. Every polynomial of degree n can be expressed as a 
factorial polynomial of the same degree and vice versa. 
EXAMPLE 6.6 


Express y = 2x° — 3x” + 3x — 10 in factorial notation and hence show that 
A®y = 12. 
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Solution: 


First method: Let y = A[x]* + B[x]? + C[x] + D. 


Using the method of synthetic division (p.29), we divide by x, 
x—1,x- 2, etc. successively. Then 


x3 x2 4 

‘ 2 3 3 -10=D 
— 2 Al 
2 =I) 

2 _ 4 2=C 
2 

3 3=B 

2=A 
Hence y = 2[x]° + 3[x}? + 2[x] - 10 


A,=2 x 3[x] +3 x [x] +2 
A’y = 6 x 2[x] +6 
A®y = 12, which shows that the third differences of y are constant, as 
they should be. 


Obs. The coefficient of the highest power of x remains un- 


NEE changed while transforming a polynomial to factorial notation. 


Second method (Direct method): 
Let y= 2? = Se" + ox = 10 

= I2x(x — 1)(x — 2) + Bx (x - 1) + Cx+D 
Putting x=0,-10=D. 


Putting x=1,2-34+3-10=C+D 
C=-8-D=-8+10=2 
Putting x=2,16-12+6-10=2B8+2C+D 
1 1 
B=—(-2C — D)=—=(-4+10)=3 
L(-20-D)=h(-4410) 
Hence y = x(x — 1)(x — 2) + 3x(x - 1) + 2x - 10 


= 2x]? + 3[x])? + 2[x] -— 10 
A, = 2x3[x]? +3 x 2[x] + 2,A’y = 6 x 2[x] + 6, A®y = 12. 
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EXAMPLE 6.7 


Express u = x4 — 12x° + 24x? — 30x + 9 and its successive differences in 
factorial notation. Hence show that A°u = 0. 


Solution: 
Let u = A[x]* + B[x]}? + Clx]? + Dix] + E. 


Using the method of synthetic division, we divide by x, x — 1, 
x — 2, x —3 successively. 


Then 
x4 3 2 x 
1 1 -12 24 ~ 30 9(=E) 
0 = 13 
9 1 -—Il 13 —17(=D) 
0 2 —18 
3 1 ~9 — 5(=C) 
0 3 
=a) | =6(=B) 
Hence u = [x]* — 6[x]° — 5[x]? - 17[x] +9 
Au= 4[x]° — 18[x]?- 10[x] -— 17 
Au = 12[x]? - “ ©] -— 10 
24[x] - 
Atu=24 and Au=0 
EXAMPLE 6.8 
If f(x) = (2x + 1)(2x + 3)(2x + 5)---(2x + 15), find the value of A*fix) 
Solution: 


15 13 3 1 
We have f(x) = 2*( a 3 al + =) os (: + al + ;) [There are 8 factors] 


7 6 
Af (x) = 2° x3[x+>| ; A? f(x) = 2° xsx7[x4+>| 
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AP ig=2? x 56%6| +2 


. ie; 
A? f(x) = 25 x 336 x sf. + =| 


8 15 13 ll 9 
= 2° X1680] x + x+ x+ x+ 
2 2 2 2 


= 26880 (2x + 9) (2x + 11) (2x + 13) (2x + 15) 


6.5 Reciprocal Factorial Function 


a 1 a Jon ; a . : 
The function pales = is denote d by [x]” and is called a 


reciprocal factorial function. 


If the interval of differencing is h, then 


[x] = 1 
(x th)(x + 2h)-++(x + nh) 


Which is called a reciprocal factorial function of order n 


Differences of 


[x}" =[x +h} — [x] 


1 1 
~ («+ 2h)(x+3h)..lx+n+lh) (x th)(x+2h)...(x+ nh) 
l = 
“a 
=—nh [x]7"t (i 
Similarly A’[x]™ = (— 1)?n(n + Ih*[x]-%*” 
In general, A?/x]" =(—1)'n(n +1)...(n + r+ Dh ix}? (ii 


In particular when h = 1,A"[x]~" = (— 1)'n(n + 1)..n + r+ 1)@)rr 
Similarly A’[ax + b]™ = (- 1)n(n +1)... (nt+-r—-Dath'[ax + bl *” (iti 


Thus we have an important result: 


A[x}" =—n[x}*? :Alax + by" =—nalax +b}? (iv 
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6.6 Inverse Operator of A 


The process of finding y, when Ay, is given is known as inverse finite 
difference operation. 


ie, IfAy,=u,theny,=A~'u, 
The symbol A ‘orl/A is called the inverse of the operator A. 


Thus we have two important results 


7 [al _ [ax pi 
A" [x]? = ;A~* [ax + b]" =———_— 
tx] ntl’ lax a(n +1) 
7 7 [x] 7 7 [ax + bp? 
Aw! y 0" = 2 — -AT fax + bY" = ST 
tx] —nt+l ’ lax a(—n + 1) 


i.e., A—1is analogous to D — lor integration in calculus. 


EXAMPLE 6.9 
Obtain the function whose first difference is 2x° — 3x? + 3x — 10. 
Solution: 
Let f(x) be the function whose first difference is given. 


We first express Af(x) as a factorial polynomial. Referring to Example 
6.6, we have 


Afi) = [x + 3x)? + 2[x] — 10 
fl) = A-42[xP + 3[x)? + 2[x] - 10} 


a —10[x]! 


=5(0 1)(x— 2) (x—-3)4+x(x—-1)(x—2) +x(x-1) -10x 


1 ae 
=— x4 —9x° +47 — 12x 
2 2 


EXAMPLE 6.10 


1 
If y= (3x4 D(Gx+4)(3x+7) evaluate A’y. Also find Ay. 
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Solution: 
1 1 1 27 
i) We have y=— =—|x- 
it) Weave: y= 5/1 ea 4) ae TD) ax | 
1 -4 
Ay =5-(-3)|x- 2/3] 
2 1 =5 
A, = 57 -3)(-4) x - 28] 
te 1 
9 (x+1/3)(x+4/3)(x+7/3)(x + 10/3)(x + 13/3) 
: 108 
~ (3x +1)(3x + 4)(3x +7)(3x + 10)(3x +13) 
1 -3 
aes [x-23] ol 1 
I O72 54 (x +1/3)(x + 4/3) 
7 1 
6 (8x +.1)(3x + 4) 


6.7. Effect of an Error on a Difference Table 


Suppose there is an error é in the entry y, of a table. As higher differ- 
ences are formed, this error spreads out and is considerably magnified. Let 


us see, how it effects the difference table. 
The below table shows that: 


(i) The error increases with the order of differences. 


(ii) Thecoefficients ofe’sin any columnarethe binomial coefficients of 
(1 - e). Thus the errors in the fourth difference column are e, 


— 4e, Ge, — 4e, €. 


(iii) The algebraic sum of the errors in any difference column 


is Zero. 


(iv) The maximum error in each column, occurs opposite to 


the entry containing the error, i.e., .y. 
5 
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The above facts enable us to detect errors in a difference table. 


x y Ay A’y A’y A‘y 
Xo Yo 
At 0) 
x yy A“ 0 3 
Ay, : A'Y, 
5 Yo A’y, AYY, 
Ay, ay | ee cil 
x, Y5 | A’y,+€ 
|| i A’y,+é 
x, Go weer Ay,té . Aty, — 4€ 
ee ae Ay, +€ My = Be 
ae ei yt € A*y, — 2€ A*y., + Ge 
TE as = Ay, —€ A®y , + 3€ 
x a A*y,+€ . Aty ,— 4€ 
i i en My = 
a y- si Aty.+6é 
Ay. | i ee 
X Ys A’; 
Ay, 
Xy Yo 


EXAMPLE 6.11 


One entry in the following table is incorrect and y is a cubic polynomial 
in x. Use the difference table to locate and correct the error. 


x: 0 1 2 3 4 5 6 7 
y: 1 = 1 = 1 
Solution: 


The difference table is as under: 


25 A 
ae 
Bo ohare 
8 ccuausuesseeeeeeerer™ I 
age 
5 ae 18 0 3 2 
ASSES Re 9 9 6 
5 2% aoc oa 9 0 
45 18 nice 4 
! | 13 sar eee 
76 
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y being a polynomial of the third degree, A®y must be constant, i.e., .the 
same. The sum of the third differences being 15, each entry under A*y must 
be 15/5, i.e., 3. Thus the four entries under A®y are in error which can be 


written as 

3+(-),3-3(-1),34+3(-1),3-(-l) 
Taking ¢= — 1, we find that the entry corresponding to x = 3 is in 
error. 


yte=18 
Thus the true value of y= 18 —e = 18 — (— 1) = 19. 


EXAMPLE 6.12 


Assuming that the following values of y belong to a polynomial of de- 
gree 4, compute the next three values: 


ne 0 ih 2 3 4 5 6 7 
y: cl tt |i.) a 
Solution: 


We construct the difference table from the given data. 


x y Ay A’y A®’y A‘ty 
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Since the values of y belong to a polynomial of degree 4, the fourth dif- 


ferences must be constant. But A*y = 16. 


.. The other fourth order differences must also be 16. Thus, 
A*y, = 16 = A®’y, — A*y, 
Leé., A®y, = A*t _+ Aty, =8+ 16 = 24 
A’y,= A’y, + A®°y,= 4 + 24 = 28 
Ay ,= Ay,+ A’y,= 2 + 28 = 30 
and y,=y,+ Ay,=1+30=31 
Similarly starting with A*y, = 16, 
we get A®y, = 40, A’y, = 68, Ay, = 98, y,, = 129. 
Starting with A‘y, = 16, 
we obtain A®y = 56, A’y. = 124, Ay, = 222, y= 351. 


Exercises 6.2 


1. 


3. 


Express x° — 2x? + x — linto factorial polynomial. Hence show that 
A4fix) =0. 


. Express 3x4 — 4x3 + 6x? + 2x + 1 as a factorial polynomial and find differ- 


ences of all orders. 


Find the first and second differences of x*+ — 6x? + 11x? — 5x + 8 with 
h =1. Show that the fourth difference is constant. 


. Obtain the function whose first difference is (i) 2x° + 3x? — 5x + 4. 


(ii) x4 — Bx? + Bx + 4. 


5. Show that A[x(x + 1)(x + 2)(x +3)] =4(x + 1)(x + 2)(x +3). 


If y= 


. Find A‘f(x)when f(x) = (2x + 1)(2x + 3)(2x + 5)...(2x + 19). 


1 
(4x + 1)(4x + 5)(4x +9) 


> find A’y and Ay. 


. Givenlog100 = 2, log101 = 2.0043, log103 = 2.0128, log104 = 2.0170, 


find log 102. 


. Find the first term of the series whose second and subsequent terms 


are 8, 3,0,-1,0. 
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10. Write down the polynomial of lowest degree which satisfies the fol- 
lowing set of numbers: 0, 7, 26, 63, 124, 215, 342,511 


6.8 Other Difference Operators 


We have already introduced the operators A, A, and 0. Besides these, 
there are the operators E and [, which we define below: 


Shift operator E is the operation of eee ee the argument x by h so that 


E fix) =flx +h), E°f(x) =flx + 2h), Ef(x) =flx + 3h) ete. 
The inverse operator E~'is defined by E~ 'f(x) = f(x — h) 


If y, is the function f(x), then Ey, =y, , ,.E~'y,=y,_,-E"y, =Y,, 4 Where 
n may be any real number. 


1 
Averaging operator jis defined by the equation HY, = a(%. L h+ y 1 ; ) 


Obs. In the difference calculus E is regarded as the fundamen- 


ONE al operator and A,V, 6, 1 can be expressed in terms of E. 


6.9 Relations Between the Operators 


We shall now establish the following identities: 
(i) A=E-1 aah 

(ii) 6 = EM -E (io) w= ZB! +E) 
(v) A= EA= AE =0E]1/2 oi) Be 

Proofs.(i)Ay, =y,,,— ¥, = Ey, — y, = (E- ly, 


This shows that the operators A and E£ are connected by the sym- 
bolic relation 


A=E-1 or E=1+A. 


Obs. These relations imply that the effect of operator E on yx is 
the same as that of the operators (1 + A) on yx.The operator's E 
and A do not have any existence as separate entities. 


NOTE 


(Gi) = Ay. =y,-9,_,=9,- Ey, = (1- Ey, 
A=1-E7-}! 
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x 


(iit) OY, = Jae + Y 4, = fale -E Ny. = (ee -E™)y 
“2 ~ 


I 1( i 2 L u -;) 
iv) wy, =—(y 1. + ==\E2y,—E 2y,)=—\E2 —E 2)y, 
(iv) MYs 2 tan Fel 2, Ix Ix 2 I 


u= s(E” = pn) 


(v) EAy, = Ey, =U) = Hy EY 3, = Yh - Y, 7 Ay, 


EA=A 
AEy, = AY. = Yen Ye = AY: 
AE=A 
‘ 1 1 1 
OBEN yx ~ oy 1, ~ Y aly 7 ie . Y aly - ae 7 a Yxth a Yx = At x 
a”) a) a) 
dE =A 
Hence A= EA=AE=06E” 
i ’ he ”" 
(vi) Ef(x)= fe th)= fla) +hf@)+ > fet 


he? [by Taylor’s series] 
= f(x) +hDf (x) + Df a) + 


KD? hp? 
+ 


=|1+hD+ 
2! 3! 


f(x) =e” f(x) 


Cor. = E=l+A=el” 


A table showing the symbolic relations between the various 
operators is given below for ready reference To prove such rela- 
tions between the operators, always express each operator in 
terms of the fundamental operator E. 


NOTE 
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Relations between the various operators 


In terms of E A Vv ) hD 
_ _y)-l nD 
E A+1 (1-V) ee 15 e 
+ Av(1 + 87/4) 
= == _y)yl_ nD _ 
A E-1 (1-V) 1 Ly e 1 
AV(1 + 8/4) 
Vv 1-E-1 1-(1+A)-!| — ls l-e' 
ees) 
+ AV(1 + AY/4) 
o EV@—-E-@ | Ad+A)-2 [Ad-ay2 [— 2sinh(hD/2) 
u Lime. pint (+42) | (1 +A2) V1 + A%/4) cosh(hD/2) 
2 aaa a) -12 1/2 
(1+ A) (1+ A) 
hD log E log(1 + A) log(1-V)! | 2sinh” (8/2) — 


EXAMPLE 6.13 


ete dt A’\ . Ee* 

‘ e =|— |e :-—_, 
rove tha E Are" 
EXAMPLE 6.14 


Prove with the usual notations, that 


(i) hD = log(1 + A) = — log(1 — V) = sinh-'(ud) 


(ii) (EY? + E")(1 + A)@=24+A 

(iii) A- V=AV =8 

(iv) A®y?= A®y.. 

Solution: 

(i) We know that e’?=E=1+A 
hD = log(1 + A) 

Also 


We have prove that 


anid b= Fl2_ Rl? 


hD = log E = — log(E™) = — log(1 - V) 


u =5(e”" +E'?) 


“d= s(E + FY2)(pl2 — FZ) 


,the interval of differencing being h. 


[«. E1=1-V] 
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= 5(E-E")= s(e —e") =sinh(hD) 


ie, hD = sinh ' (6d) 
Hence hD = log(1 + A) = — log(1 — A) = sinh — 1(u8). 
(ii) (EM? + E-)(1 + A)!” 
=(E@ +E ™)EM=aE+1=1+A4+1=24A. 


We know that A=E-1,V=1-E™ and A=E!?-E!” 
A-V=E-2+E'=(E"-E™)=8 

Also AV =(E-1)1-E')=E+E'-2 
EO ae ee) age 

Hence A-V=AV=5. 

(iv) A’y, = (E- 1)*y, [ A=E-1] 
= (E°- 3E? + 3E - l)y, 
=y,— 3y,+ 3y,-y, (1 

A’y. =(1-E>)°y, [ =1-E4] 
=(1-3E1+43E?-E*)y, 
=y,— 3y,+ 3y,-y, (2 
From (1) and (2), Ay = A’y. 
EXAMPLE 6.15 


Prove that 


2 
i) Aaist+e +=) 
2, 4 


(ii) = 1+0°W? =(1+50°| 


2 A 1 9 
iy = —__. + 1+-—0* 
(iii U 2 ( 
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Solution: 


i) ese +=) 
OD, 4 


_ =e aD ae a(n a a i+ iain ae 
Es 


=5 (E+ E* —2)+(EM? —E-*) (E+E 1 +2)/4] 
=(E+E" —2)+(E"" ey eC i +E ?y2 
=S((E+ E12) +(E-E)J=E-1=A 
(ii) We know that A = E¥? — E-!” and uw = (E+ E-!”)/2. 
ce L.H:S. = 1 + 67u? = 1 + (El? = E-'?)(E + E-'?)?/4 
1 ay eee 1 
=—[44+(E-E')]=—(E° +E* +2)=—(E+ E")2 
rm ( | 7 ) ri. ) 


2 


2 
RHS. =(1+26? -[1+per-£)' | =|143(e-2'-2)| 
2 Z 2 
1 2 
Hence 14+067y? =(1+56"| 
(ii) Since A= E-1,6=E'*-E™”” and was (Ee —E-'?) 


2+A  2+E+1 _ E+ 
Q2J1+A 2/1+E-1 2VE 


=>(E”" +E ?)=y 


Also f+te"] = if +2(E" -EY | = (ister -2)) 


1 TL siys 
=a (E+E | +2) a +E '?)=y 


(1) 


(2) 
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Hence from (1) and (2), we get 
Q+A [ise 
ee +38] 
OSA ( 4 
EXAMPLE 6.16 
1 D. 

Prove that Vy,4) = h(t + ri + io + ly 
Solution: 


We have V4 = Un ~ Yn = (E ~ 1)y, 


2 Sl 


272 373 
D D 
(0 -Dy,=[.+nD+! t toon ly 


Since E'=1-V=e™, 


ee | 
iDs-legleN)aV eV tv ts 
1 li, 1 
Viuna =A 143(V4ovi+iv+.| 
2 2 3 
1 Teg Ue 
6 2 3 
ence VYn+ = 2 12 Yn 


6.10 To Find One or More Missing Terms 


When one or more values of y = f(x) corresponding to the 
equidistant values of x are missing, we can find these using any of 
the following two methods: 


First method: We assume the missing term or terms as a, b etc. and form 
the difference table. Assuming the last difference as zero, we solve these 
equations for a, b. These give the missing term/terms. 
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Second method: If n entries of y are given, f(x) can be represented by 
a(n — 1)" degree polynomial, i.e., An y = 0. Since A = E — 1, therefore 
(E — 1)n y = 0. Now expanding (E — 1)n and substituting the given values, 
we obtain the missing term/terms. 


EXAMPLE 6.17 


Find the missing term is the table: 


x: 2 3 4 5 6 
Y: 45.0 49.2 54.1 ae 67.4 


Solution: 


Let the missing value be a. Then the difference table is as follows: 


X y Ay A’y A®’y A‘y 
2 45.0( = y,) 

4.2 
e 49.2( =y,) 0.7 

4.9 a-59.7 
4 54.1( = y,) ia — 59.0 240.2 — 4a 

a-54.1 180.5 -— 3a 
5 a(=y,) 121.5 - 2a 
67.4-a 

6 67.4(=y,) 
We know that A*y = 0, i.e., 240.2 — 4a = 0. 
Hence a = 60.05. 


Otherwise. As only four entries y,,y ,y,,y,are given ,therefore y = f(x) can 


be represented by a third degree polynomial. 
A®’y = constant or A*‘y=0,ie., (E—1)*y=0 
i.e., (E*—-4E°+6E°?-4E+1)y=0 or y,-4y,+ 6y,— 4y, +y,=90 
Let the missing entry y, be a so that 
67.4 — 4a + 6(54.1) — 4(49.2)+45=0 or -—4a=- 240.2 
Hence a= 60.05. 
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EXAMPLE 6.18 


Find the missing values in the following data: 


Xx: 45 50 BD 60 | 65 
y: 3.0 a 2.0 an | =8A 


Solution: 


Let the missing values be a, b. Then the difference table is as 
follows: 


x y Ay A’y A®y 
45 3( = Yo) 

a-3 
50 a(=y,) 5 — 2a 

2-a 3a+b-9 
55 2(=y,) b+a-4 

b-2 3.6 -—a—36 
60 b(=y,) -0.4-2b 

-24-b 
65 -2.4(=y,) 


As only three entries y,, y,, y,are given, y can be represented by a sec- 
ond degree polynomial having third differences as zero. 


A®y, =0 and A*y, =0 
Leé., 3a+b=9,a+3b=3.6 
Solving these, we get a = 2.925, b = 0.225. 


Otherwise. As only three entries y, = 3, y, = 2, y, = — 2.4 are given, y can 
be represented by a second degree polynomial having third differences as 
ZeYrO. 


A®y, = 0 and A®y, = 0 


i.e., (E — 1)°y, =0 and (E — 1)°y, =0 
i.€., (BE? - 3H? + 3 — ly, = 0; (9-38? + 3E -1)y, =0 
or Ys — 3Y, + 8y, — Yy = 95 y, — Sy, + 8y, — y, = 9 


OE y, + Sy, = 9; 3y, +y, = 3.6 
Solving three, we get y = 2.925, y = 0.225. 
1 2 
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EXAMPLE 6.19 


The following table gives the values of y which is a polynomial of degree 
five. It is known that f(3)is in error. Correct the error. 


x: 0 1 2 3 4 i 6 
Y: 1 2 33 254 1025 3126 T7777 
Solution: 


Let the correct value of y when x = 3 be a. Then the difference table is 


as follows: 
x: y: Ay A’y A’y A‘y A’y A‘y 
0 1 
1 
1 2 30 
31 a-94 
2 3 a— 64 1216—4a 
a-—33 1122-3a —2320-10a 
A 1058—2a —1104 + 6a) 4880—20a 
1025-a 18+ 3a 2560 — 10a 
1025 1076 +a 1456 — 4a 
2101 1474-a 
3126 2550 
4651 


Since y is a polynomial of fifth degree, the sixth difference A®y = 0 


1.€., 


Hence 


4880 — 20a = 0 
a= 244, 
Otherwise. As y is a polynomial of fifth degree, the sixth difference A°y =0 


(E- 1)*y =0 
(E° — 6E° + 15E* — 20F° + 15E?-6E + 1)y, =0 
Ye 6y, + 15y,- 201 ar 15y, — by, TYy= 0 


7777 — 6(3126) + 15(1025) + 20y, + 15 (33) — 6 (2) +1=0 


4880 = 20y, 


Hence the error = 254 — 244 = 10. 


ys = 244 
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EXAMPLE 6.20 


Thy 9 = 3,41 = 6, Yo = LL ys = 18, 4 = 27, find y, 


Solution: 


Taking y,,as u,, we are required to find y,,i.e., .w_,,-Then the difference 


table is 
x u Au Au Au 
v4 Yo =U 423 
3 
t_3 Yu =U, =6 2 
5 0 
Xi Y,,=U_,=11 2 
7 0 
ty Yj,=U_,=18 2 
9 
Xo Y yg = Uy = 27 
Then y,=U_, = (E7')"u, =(1— A)"u, 
= 10.9 10.9.8 
=11=10v4—__V = _ Vee Up 
2 1.2.3 


=u, — 10Au, + 45A°u 9 ~ 120Au, 
=27-10x9+45 x 2—120 x 0 = 27. 


EXAMPLE 6.21 


If y, is a polynomial for which fifth difference is constant and y, + y.= 


— 784, y, + y, = 686, y, + y, = 1088, find y,. 


Solution: 


Starting with y instead of y,, we note that A°y, =0 [+ A®y, is constant] 


ie, (E- 1)*y; = (E° —- 6E° + 15E* -— 20F° + 15E? -6E + l)y, =0 
; y, — 6y, + 15y, — 20y, + 15y, - 6y, +y, =0 
or (y, +y,) — 6(y,+y,) + 15 (y, + y,) — 20y, = 0 


1 
ie, Ya = ZL (Yi FY) Gyo + Yo) + 15(ys + ys) 


= =,[-784-6(686) +15(1088)]= 571 
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EXAMPLE 6.22 


Using the method of separation of symbols, prove that 


2 3 
(i) ux + ugx” +ugx® +++ =—u, +(*) Au, +(} Au, +: 
1l-x l-x l-x 
2 
Aug + 


2 3 
+e U,x UgX UgXx x 
(ii) 4+ 3 — 
2 


Uy + a 
er, 3! 3 


3 
teome’[uy tay + “Ant 


Solution: 
(Gi) LHS= xu, +x°Eu, +x°Eu, ++ 
1 
—xE 


a x(1+xE +x°E* $e)u! mir 4,» taking sum of infinite G.P. 


=| am [EB =14A] 


x 7 ne 
= 1+ + u 
1-x 1-x (1-x) 
2 3 
=u, +—*— Au +—*—Au+ =RHS 


(1-x) 


2 3 
il = is - 2 iz 3 wae 
(ii) L.H.S. eT a a Eu, + a Eu, + 


i O° Si 


{ ch rh oh 
=e"| 1+—+ + see le 
1! 2! 3) 


272 3 3 
XE x E x E 
= [ _— + an =¢"u, =e "uu =e". up 


2 3 
=e" urs an ara ale | =RHS 
rT 21 3! 
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Exercises 6.3 


1. Explain the difference b A Aru, 
. Explain the erence between u,and - : 


2. Evaluate taking h as the interval of differencing: 


(i) sinx (ii). (A+V) (x? +x),(h =1) 
awe i, ON A’ sin(x +h) 
i= eee 
me Ex E inlet) Esin(x +h) 
3. With the usual notations, show that 
2 _({0 
(i) A=1-e (ii) D=—sinh (3) 
h 2 


(ii) G+ A)O-V)=1 (iv) AV=VA=02 
4. Prove that 
i) S=A(1+A) =V(1-V) 


2 
i) w= 14S (it) (EV +E? )=AET+A 
5. Show that 


i) A= AE-'2 = AE? 


ee 5(A +V) (i) 14872 = VL + 8x2) 


6. Show that 


52 Fy. 1/2 P) 

(i) A= wd +— (ii) pie =(14 | a 
2r 
pra pees) hp Ae 
2 2A(1+A) 2A4(1+V) 
7. Prove that 

A V 

(i) OP (ii) V=AE"' =E'A=1-E"! 
: 7 

(iii) E= dV, (iv) V* =D! WD + WD’ 
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8. Prove that 6°ys = yg — 2ys + yy. 
9. Prove with usual notations, that 


i) Vf, =A" fre 


n-1 


AP Jat ht Da i) Saf =af,- af 
k=0 


10. Estimate the missing term in the following table: 


x: 0 1 2 3 4 

fix) 1 3 9 = 81 
11. Find the missing terms in the following table: 

x: 1 15 2 9.0 3 3.5 

y: 6 > 10 | 20 ? 15 
12. Find the missing values in the following table: 

0 1 2 3 4 5 6 

5 11 22. 40 one 140 


13. Estimate the production for 2004 and 2006 from the following data: 


Year: 2001 2002 | 2003 | 2004 | 2005 | 2006 | 2007 
Production:| 200 200 260 350 as 430 


14, If Uj3 =LU, =—-3,0j5 =—-1LU yg =13) find i, 


15. Evaluate y , from the following data (stating the assumptions you make) 
Vo + ¥g = 1.9243, y, + y, =1.9590 
Jo +e =1.9823, y, + y, =1.9956 

Using the method of separation of symbols, prove that 


1 1 il 2 
16.u+ut+ut--tu=""Cu+" Cau t+” CAut-- 
0 1 2 n 1 0 2 (0) 3 0) 
gee Ka 
n+1 0 
17.A% =u —-"Cu +"Cu oom ( = 1) 8 
x x+n 1 x+n-1 2 x+n-2 x 


"*C Ay gh "GAD net (- 1 a'’y 


n—(n—x) 


18.y =y - 
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6.11 Application to Summation of Series 


The calculus of finite differences is very useful for finding the 
sum of a given series. The inverse operator A—l(Section 6.6) is espe- 
cially useful to find the sum of a series. This is explained below: 

Ifu.=Ay,=y,.17Y 


r 


then uy, 7 Ys ~ Y> Us, = Ys > Ys ~ en Yn ~ Y,, -) u,, a Y, +1 yy 


_ r=nt+l 
“ u, tu, + tu =y y= A My. 
r=] 
n aj. (P=Enrrl 
Thus > u, =A ue r=l . yr=Atu)] 


r=l 
The method is best illustrated by the following examples 


EXAMPLE 6.23 


Find the sum to n terms of the series 
(i) 2.3.4 + 3.4.5 + 4.5.6 +--- 


fai’ .- al 1 1 

(ii) + + - 
3.4.5 4.5.6 5.6.7 

Solution: 


(i) Let )'u, =2.3.443.4.544.5.6+-+-(n+1)(n+2)(n+3) 


r=l 


u,. = (r+1)(r+2)(r+3)= [r+3]}° 


n 


= =4 r=nt+l 
) U, =|A ue | 


={[n +4} -[41} 
=={(n +4)(n+3)(n+2)(n+1)—-4.3.2.1} 


= A{(n-+4)(n +3)(n+2)(n-+1)-24} 


n 


(ii) Let S : + : + : feet : 
u 2 = eee 
= " 345 45.6 5.6.7 (n+2)(n+3)(n+4) 
u : =[r+ if 


(r+2)(r+3)\(r+4)_ 
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See afaty FeY = fate ep 


ae 1 ch Ne Te, 1 
— 9 (n+3)(n+4) 3.4 ~ 2}12 (n+3)(n+4) 


EXAMPLE 6.24 
Seka a8 3 
Sum the following series 1 +2" +3" +----+n 
Solution: 


. 3 93 93 3 
Denoting 1°,2°,3°,---,n" by uo, U,Ug,"** respectively, the required sum 


S = Up Tuy FUy Fe FU, 


= (l+E+E +--4+E"") E Uy = Eup, Uy = E°ug | 
E"-1 _(14A)-1 
E-1° A’ 
1 n(n—1) 5. n(n—1)(n—2 
_* L+na+ 2 ) a2 4 Bln \(n Lx. died Uy 
A 3! 
ned n(n—1)(n—2) |. 
sc ae ge 


2) 3) 
Now Au, =u, -u,=2?- P=7, Au, =u? - 2u, +u,=3°- 2.2? + P=12, 
A®’u, =u, — 3u, + 3u, —u, = 4 — 3.39 + 3.28 - P=6 
and A‘u,,A°u,,---are all zero as w= r’is a polynomial of third degree 


Hence S=n+ nin D a4 mn Wr Pi9 4 mn DO NN=9) 


= *(n® +2n+1)+ [eeuy 
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EXAMPLE 6.25 


Prove Montmort’s theorem that 


2p2 
9 Up xAuy x A*up 
Ug FUyXFUgX +--+ O= r anand 
l-x (-x) (=x) 
Hence find the sum of the series |.2+2.3x+3.4x? +++++00 
Solution: 
U + uxt yx” +--+ 0= (l+xE+°E° +.°R° +---+00) uy 

1 1 
_ Uy = u 
l-xE ° 1-x(1+A) ° 


1 1 1 x a) 
= Uy = _ u 
(l-x)-xA ° (1—x) l-x 


2 
_ Uy x 
(1-x) (i- x) 
Now let us construct the difference table for the coefficients of the 
given series: 


2 
A?uy +-++00 


x 
+ Auy + 
(l-x) 0 


u Au Mu A3u 

u,=2 

4 
u, =6 2 

6 0 
u,= 12 2 

8 0 
u, = 20 2 

10 
u,= 30 


This shows that u, = 2,Au, = 4, A’u, = 2, A®°u, = A*u, ete. all = 0. 


Thus 1.2+2.3x + 3.41? + --- +00 
— * na 
=U, tux +UX + +++ +00 
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(1-x) 


_ 2 , 40 a. 2 
I-x (l-x) (i-x)’ (=x)? 


Up 


(22) 


7 Aug + ; Muy +22°% 


Exercises 6.4 


Using the method of finite differences, sum the following series: 


1.254+584+8.114+11.144+---n terms. 
2.1.2.342.3.443.4.5 + ---.ton terms 


3. 1 a 1 oe 1 4... ton terms 
123 234 3.4.5 
1 1 
4, —— +—— + ——-+ ::- ton terms 
456 5.6.7 6.7.8 
5. 17497 +37 +---+n? 
ShowGictay he ae ea eat 
6. Show that Up T 7 =e |=Up 7 WU Tl Uo 
Hence sum the series 
93 3° P 4? ‘ 
i) txt +—42° ++ +00 
1! 2! 3! 


Ax 10x” 20x? 35x* 56x" 
+ + + + 

1! 2) 3) 4) 5! 

7. Using Montmort’s theorem find the sum of the series 

1343.5" +5.7x7 +7.9x° +---+0 


M4 eee ee Fo 


ii) 1+ neh o0 


8. show that Su =nCyu, +" C,Au, +" C3;AX72u, + +A" r= 


Hence evaluate 14 + 24+ 34+.--- +n. 
9. Sum the series 1.2Acn — 2.3A2x" + 3.4A°x" — 4.5A‘e" + ---ton terms 


10. 
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Show that Ax” — 1 Ate gas poe +...ton terms = 
2 2.4 2.4.6 


(x+1/2)" —(x-12)" 


6.12 Objective Type of Questions 


Exercises 6.5 


Select the correct answer or fill up the blanks in the following questions: 


1.AV= 
(a) VA (b)V+A (c) V-A. 
2. Which one of the following results is correct: 
(a) Aa! (b) Ax =nx"-) 
(c) A"e* =e" (d) A cosx =— sinx. 
3. Lf f(x) = 3x3 — 2x? + 1, then A3f(x) = --- 
4. The relationship between the operators E and D is---. 
5. The (n + 1)th order difference of the nth degree polynomial is--- 
6. If y(x) =x(x — 1) (x — 2), then Ay(x) =---.. 
7. x3 — 2x? +x — 1] in factorial form = ---... 
8. Taking has the interval of differencing, A’x* = --- 
9. Interms of E,A=---. 
10. The form of the function tabulated at equally spaced intervals with sixth 


—_ 
—_ 


12. 


13. 


differences constant, is--- 


. If the interval of differencing is unity, then A*[(1 —x)(1 — 2x)(1 - 3x)] = 


Taking the interval of differencing as unity, the first difference of 

xt — 3x3 + 2x -Lis---. 

The missing values of y in the following data: 

yx: 0 2 = ot 25 
Ayx: 1 2 4 7 ll, are:-- 
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14. 
15. 
16. 
17. 
18. 
19. 
20. 
21. 


22. 
23. 
24. 


25. 
26. 
27. 
28. 


29. 


30. 


31. 
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A®[(1 —x)(1 — 3x)(1 — 5x)] = --- (interval of differencing being 1) 
Atan-lx=..., 

If y =x? — 2x + 2, taking interval of differencing as unity,A*y = ---. 
Relation between A and E is given by---.. 

The kth difference of a polynomial of degree k is--- 

A'y, in terms of backward differences = ---. 

The value of (A?/E)e*= ++. 


The relation between the shift operator E and second order backward 
difference operator A? is--- 


The value of A"(e*) = ---(intervalofdifferencingbeing1). 
Relationship between E, A and A is--- 


If the fifth and higher order differences of a function vanish, then the 
function represents a polynomial of degree: --. 


The value of E-'A=.-.--. 
If Pu, =x? andh =1, thenu,=--- 


Given y, =2,y,=4,y,=8,y, =32,then y,=---. 
Yo Y, 2 Y4 Y3 


Yo LY = 9,4, = 9,093.9, = y, = 0, then A’y, = 
(a) 61 (b) — 62 

(c) 62 (d) -61. 
Givenx=123 

f(x) =3 815, then A’f(1) = 

(a) 38 (b) 4 

(c) 2 (d) 1 

(El? + E-'?)(1+A)!? = 

(a)A+1 (b)A-1 

(c) A+2 (d) A-2. 

Which one is incorrect? 

(a)E=1+A (b) A(5) =0 

(c) AG, +f.) =AF+ AF (d) AG, .f,) = Af, + Af, 


32. 
33. 
34. 
35. 
36. 
37. 
38. 
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A-V=0. (True or False 
A+V=E +E+ (True or False 
E=e"., (True or False 
If f(x) = e*,then A°e* = (e"— 1)%e*. (True or False 
A" = 6"E"? (True or False) 
(1+ A)(1-V)=1. (True or False 
With the usual notations, match the items on right hand side with those 


in left hand side: 


(i) EV (a) 5 (A +V) 
(ii) hD (b) A-V 
(iii) VA (c) A 
(iv) ud (d) —log(1 —- V) 


CHAPTER 


INTERPOLATION 


Chapter Objectives 


Introduction 

Newton’s forward interpolation formula 
Newton’s backward interpolation formula 
Central difference interpolation formulae 
Gauss’s forward interpolation formula 
Gauss’s backward interpolation formula 
Stirling’s formula 

Bessel’s formula 

Everett’s formula 

Choice of an interpolation formula 
Interpolation with unequal intervals 
Lagrange’s interpolation formula 

Divided differences 

Newton’s divided difference formula 
Relation between divided and forward differences 
Hermite’s interpolation formula 

Spline interpolation—Cubic spline 

Double interpolation 

Inverse interpolation 


Lagrange’s method 
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e Iterative method 


e Objective type of questions 


7.1 


Introduction 


Suppose we are given the following values of y = f(x) for a set of values 
of x: 


x: Xo x, X77 X, 


y: Y, y, J Pee 


Then the process of finding the value of y corresponding to any value of 
x =x, between x, and x, is called interpolation. Thus interpolation is the 
technique of estimating the value of a function for any intermediate value 
of the independent variable while the process of computing the value of the 
function outside the given range is called extrapolation. The term interpola- 
tion however, is taken to include extrapolation. 


If the function f(x) is known explicitly, then the value of y correspond- 
ing to any value of x can easily be found. Conversely, if the form of f(x) is not 
known (as is the case in most of the applications), it is very difficult to de- 
termine the exact form of f(x) with the help of tabulated set of values (x, y,). 
In such cases, f(x) is replaced by a simpler function ¢(x) which assumes the 
same values as those of f(x) at the tabulated set of points. Any other value 
may be calculated from @(x) which is known as the interpolating function or 
smoothing function. If @(x) is a polynomial, then it called the interpolating 
polynomial and the process is called the polynomial interpolation. Similarly 
when (x) is a finite trigonometric series, we have trigonometric interpola- 
tion. But we shall confine ourselves to polynomial interpolation only. 


The study of interpolation is based on the calculus of finite differences. 
We begin by deriving two important interpolation formulae by means of 
forward and backward differences of a function. These formulae are often 
employed in engineering and scientific investigations. 


7.2 _Newton’s Forward Interpolation Formula 


Let the function y = f(x) take the values y,, y,, ---, y, corresponding to 
the values x0, x1, ---, x, of x. Let these values of x be equispaced such that 
x,=x,+ ih i =0, 1, ---). Assuming y(x) to be a polynomial of the nth degree 
in x such that (xp) = yo. y(x1) = yy.°: y(x,) = Yn. We can write 
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y(X) = dy +a, (x —X9) + g(x —Xp)(x-— x1) +3 (x — Xp) (x — x (x — XQ) 
+e +a, (x-Xy)(X—xX,)--(X- 2,1) (1) 
Putting x =x,, x,, ---, x, successively in (1), we get 


Yo = 4, Y1 = Ay +44 (x1 —Xq), Yq = Aq + Ay (XQ —Xq) + dg (XQ —Xq (XQ — X1) 
and so on. 


From these, we find that dy = yy, Ayo = y; — Yo = Q(x) —Xy) = ah 
1 
a= 7 Avo 
Also Ay, = Yg — yy = ay (Xq — 1) + dg (xq — Xq (XQ —%y) 
= i + a,hh = Ay + 2h7a5 
ay = he Ay Ayo) = _ A* yo 

1 . 
Similarly a3 = 3 Yo and so on. 
Substituting these values in (1), we obtain 


At A’, 
ua) = yo + FM 0)+ orp8 


Ay 
3!h° 


(x= Xo (x — 41) + (x= xo )(x — x, )(X—Xq) Fo 


(2) 
Now if it is required to evaluate y for x =x,+ ph, then 
(f= Xp) = ph r= eh Heth - =e) Shp =D, 


(xX) =xX— Xp —(X—Xy) =(p—Dh-h=(p—2)h He, 


Hence, writting y(x) = y(x, + ph) = Hs (2) becomes 


pip-]) po 
rae, 


=1ipao 
p(p—)(p— 2) Ay 


Yp = Yo + pAyo ae 
p(p-1)---(p~n-1) 
3! 


It is called Newton’s forward interpolation formula as (3) contains y, 
and the forward differences of y, 


feet 


A" Yo (3) 


Otherwise: Let the function y = f(x) take the values y,, y,, y,,--- corre- 
sponding to the values x,, x, +h, x, + 2h, --- of x. Suppose it is required to 
evaluate f(x) for x =x, + ph, aiere) p is any ea number. 
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For any real number p, we have defined E such that 


E? f(x) = f(x + ph) 


Yp = f (Xo + ph) =E? f(xy) = (1+ A)? yo ls E=1+Al] 
( 1) (p—1)(p—2) Ki 
=f1+pa+PeoDs +r 31 : ay tly (4) 
[Using binomial theorem] 
i = 2, , Pp-l(p-2) ,3 
Le, Yn = Yo tpAyo + et — a 


If y =f(x) is a polynomial of the nth degree, then A"*!y, and higher dif- 
ferences will be zero. 


Hence (4) will become 


(p—) \: 2) A: 
Uy = yo + pAyy +E Ayo tayo 


Which is same as (3) 


Obs. 1. This formula is used for interpolating the values of y 
near the beginning of a set of tabulated values and extrapolating 
values of y a little backward (i.e., to the left) of y,, 

Obs. 2. The first two terms of this formula give the linear inter- 
polation while the first three terms give a parabolic interpola- 
tion and so on. 


NOTE 


7.3 _Newton’s Backward Interpolation Formula 


Let the function y = f(x) take the values y,, y,, y,, ... corresponding to 


the values x,, x, +h, x, + 2h, --- of x. Suppose it is required to evaluate f(x) 
forx =x, +ph, where j p is any el number. Then we have 
y, =flx, + ph) = Ep flx,) =(1-V)Py, eae] 
+1)_. p+1)(p +2) _.- 
-( +pvs e+ Ve, OO dy, 


[using binomial theorem] 
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#1) +1)(p+2 
i.€., i; =H, +p, +22 yey Pip \(p ) 


3 
9! n 3] V Yn + (1) 


It is called Newton’s backward interpolation formula as (1) contains y_, 


and backward. differences of y, 


Obs. This formula is used for interpolating the values of y near 
the end of a set of tabulated values and also for extrapolating 
values of y a little ahead (to the right) of y, 


NOTE 


EXAMPLE 7.1 


The table gives the distance in nautical miles of the visible horizon for 
the given heights in feet above the earth’s surface: 


x = height: 100 150 200 250 300 350 400 
ly =distance: | 10.63 13.03 15.04 16.81 18.42 19.90 21.27 


Find the values of y when 
(i)x=160ft. (ii) x= 410. 
Solution: 


The difference table is as under: 


a y A Ne MS ING 

100 10.63 
2.40 

150 13.03 — 0.39 
2.01 0.15 

200 15.04 - 0.24 — 0.07 
1.77 0.08 

250 16.81 —0.16 — 0.05 
1.61 0.03 

300 18.42 —0.13 —0.01 
1.48 0.02 

350 19.90 -0.11 
1.37 

400 21.27 


_ (i) If we take x, = 160, then y,= 13.03, Ay, = 2.01, A*y, = — 0.24, 
A’ = 0,08, At y, = — 0.05 
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_ xX =X 10 
h 50 


Using Newton’s forward interpolation formula, we get 


Since x = 160 and h =50, 


= 1) —l)(p-2 
Yois = Yp = Yo + pAyo + hp ayy + ne ae Ay 
4 Pip = Wp = 2p — 3) A gto 


4) 
Y 169 = 13.03 + 0.402 + 0.192 + 0.0384 + 0.00168 = 13.46 nautical miles 
(ii) Since x = 410 is near the end of the table, we use Newton’s back- 
ward interpolation formula. 
Taking x, = 400, p= an = aa =0.2 
Using the line of backward difference 
y= 21.7, Vy = 1.37, V2y,=-0.11, V° y,= 0.02 ete. 
. Newton’s backward formula gives 


p(p+1) 
Yio = Ysoo + PVY400 + Py Vib 
(p+1)(p +2) |. (p +1)(p + 2)(p +3) 
+L a A*y 409 +PP C P V* yao °° 
0.2(1.2) 
= 21.27 + 0.2(1.37) + ry (—0.11) 
Z p20 2)C2) (0.02) + 220 ICG) (-0.01) 


= 21.27 + 0.274 — 0.0132 + 0.0018 — 0.0007 


= 21.53 nautical miles 


EXAMPLE 7.2 


From the following table, estimate the number of students who ob- 
tained marks between 40 and 45: 


Marks: 30—40 40—50 50—60 60—70 70—80 


No. of students: 31 42 51 35 31 


INTERPOLATION © 279 


Solution: 


First we prepare the cumulative frequency table, as follows: 


Marks less than (x): 40 50 60 70 80 
No. of students (y,): 31 73 124 159 190 
Now the difference table is 
x Ys Ay, | Ay, | A’y, | Adyx 
40 31 
42 
50 73 9 
51 —25 
60 124 -16 37 
35 12 
70 159 -4 
31 
80 190 


We shall find y,,, i.e., the number of students with marks less than 45. 


Taking x,= 40, x = 45, we have 


| =F <5 [-- h = 10] 
Using Newton’s forward interpolation formula, we get 
Yas = Yao + pPAYao + am 2 A*ysot ee a = A* Yao 
4 Pip = te 2)(p— 3) oe 
=3140.5x42+ ©5)C0°) x 9+ SCONE 15) (—25) 
z OSNCOSNEBIE 2S) eae 


= 314+ 21 —1.125 — 1.5625 — 1.4453 
= 47.87, on simplification. 


The number of students with marks less than 45 is 47.87, ie., 48. But 
the number of students with marks less than 40 is 31. 


Hence the number of students getting marks between 40 and 45 = 
48 —31 =17. 
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EXAMPLE 7.3. 


Find the cubic polynomial which takes the following values: 


x: 0 1 2 3 
flr): 1 2 1 10 


Hence or otherwise evaluate f(4). 


Solution: 


The difference table is 


fx) Af(x) Ne oN) 
0 1 
1 
al 2 =2 
=k 12 
2 1 10 
9 
3 10 
We take x,=0 and p= =n 
h 
. Using Newton’s forward interpolation formula, we get 
a bg eel) og me Lie 2) @ 
f (x)= f(0)+ co A Or A’ f(0) 


=1+0(1) +29) 4 OE (19) 


= 9x? —7x7 +6x 41 
which is the required polynomial. 
x 


To compute f(4), we take x, = 3, x = 4 so that p= ans 


NOTE Obs. Using Newton’s backward interpolation formula, we get 


W(p+2) 
f(4) = (3) + pVf() + mete : ey? eg) 4 MPT Pt?) “ ut +2) 0403) 


=10+9+10+12=41 


vh=1] 
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which is the same value as that obtained by substituting x = 4 in 
the cubic polynomial above. 


The above example shows that if a tabulated function is a 
polynomial, then interpolation and extrapolation give the same 
values. 


EXAMPLE 7.4 


Using Newton’s backward difference formula, construct an mia 
ing polynomial of degree 3 for the data: f (- 0.75) = — 0.0718125, f (— 
= — 0.02475 f(- 0.25) = 0.3349375, f (0) = 1.10100. Hence find f (— i 


Solution: 


The difference table is 


i y Ay A’y A*y 
— 0.75 — 0.0718125 
0.0470625 
— 0.50 — 0.02475 0.312625 
0.3596875 0.09375 
— 0.25 0.3349375 0.400375 
0.7660625 
0 1.10100 


We use Newton’s backward difference formula 


oat. (p+ 1p +2) 
y(x) = ys ti Vust i Ve 


ne ee x =r [hh = 0.25] 


4x(4x + 1) 


y(x) = 1.10100 + 4x(0.7660625) + (0.400375) 


i Ax(4x +1)(4x + 2) 


(0.09375) 


= 1.101 +3.06425x +3.251x7 +0.81275x +x? +.0.75x? + 0.125% 
=x°+4,001x7 +.4.002x +1.101 


Put x= -— so that 
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1 i; iv 1 
u(-3)=(-5}*+4001(-3] +4,002{ -=}+1.101 
3 4 4 3 


0.1745 


EXAMPLE 7.5 


In the table below, the values of y are consecutive terms of a series of 
which 23.6 is the 6" term. Find the first and tenth terms of the series: 
x: 3 4 Di 6 7 8 9 
y: | 48 8.4 | 145 | 23.6 | 36.2 | 52.8 | 73.9 


Solution: 


The difference table is 


x y Ay A’y A*y Aty 
3 4.8 


9 73.9 


To find the first term, use Newton’s forward interpolation formula with 
x,=3,x=1,h=1, and p =- 2. We have 


(—2) (— ae 3) (—2)(—3)(—4) 
1 1.2.3 
To obtain the tenth ere u se Newton’s backward interpolation for- 


mula with x = 9, x = 10, h = 1, and p = 1. This a 


M2) x 4.54 12K9) (2)(3) 
1.2 =r 


y(1) = 4.8 +-—* x 3.6 +" x 2.5 + X0.5=3.1 


y(10) = 73.942 x21. += x 0.5 = 100 
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EXAMPLE 7.6 


Using Newton’s forward interpolation formula show 


si = {nin vy 


Ifs,=sn°, then s,,,= X(n+1)° 
Ag = 844 S= Sin + i) = ya =(74 1° 


Then A?*s, =As_,,—As, =(n+2)° —(n+1)° =3n? +9n+7 


Solution: 


A®s., = NS = A’s 
=[3(n +1)? +9(n+1)+7]-(3n? +9n +7) =6n +12 
A‘s, = A®s,,, —A’s, =[6(n +1) +12] -[6n +12] =6 
and AS Ns =, .5 =O 
Since the first term of the given series is 1, therefore taking n = 1, s,= 1, 
As, =8, A2s,=19, A's, = 18, Ats = 6. 
Substituting these in the Newton’s for war d interpolation formula, i.e., 
(n—-1)(n—2)(n—3) 


s=s+(n—1)As, + 2 a 2 A’s, + 31 A’s, 
2 (n-1)(n—- a — 3)(n— 4) Ate 
sn=1+8(n-1)+ — (n—1)(n—2) + 3(n-1)(n —2)(n —3) 


+ (n—1)(n—-2)(n—3)(n—4) =F (n! +2n° +n?) = jaa a} 


Exercises 7.1 


1. Using Newton ’s forward formula, fin d the value of f(1.6), if 
X: 1 14 1.8 2.2 
fix): 3.49 4,82 5.96 6.5 


2. From the following table find y when x = 1.85 an d 2.4 by Newton’s inter- 
polation formula: 
L.7 1.8 
5.474 | 6.050 


2.3 
9.974 


2.1 2.2 
8.166 | 9.025 


1.9 2.0 
6.686 | 7.389 


x: 


y=e: 
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. Express the value of 6 in terms of x using the following data: 


x: 40 50 60 70 80 90 
0: 184 204 226 250 276 304 


Also find @ at x = 43. 


. Given sin 45° = 0.7071, sin 50° = 0.7660, sin 55° = 0.8192, 


sin 60° = 0.8660, find sin 52° using Newton’s forward formula. 


. From the following table: 


ee] Ou 0.2 0.3 0.4 0.5 0.6 


fix): | 2.68 | 3.04 | 3.38 | 3.68 | 3.96 | 4.21 


find f(0.7) approximately. 


. The area A of a circle of diameter d is given for the following values: 


d: 80 85 90 95 100 


A: 5026 | 5674 | 6362 | 7088 | 7854 
Calculate the area of a circle of diameter 105 


. From the following table: 


ae 10 20 30 40 50 60 70 80 


cos x: | 0.9848 | 0.9397 | 0.8660 | 0.7660 | 0.6428 | 0.5000 | 0.3420 | 0.1737 
Calculate cos 25° and cos 73° using the Gregory-1 Newton formula. 


. A test performed on a NPN transistor gives the following result: 
Base current f (mA) 0 0.01 | 0.02} 0.03] 0.04 | 0.05 
Collector current I, (mA) | 0 1.9 2.5 3.6 4.3 5.34 


Calculate (i) the value of the collector current for the base current of 
0.005 mA. 
ii) the value of base current required for a collector correct of 4.0 mA. 


. Find f(22) from the following data using Newton’s backward formulae. 


x: | 20 25 30 35 40 45 
fix): | 354 | 332 | 291 | 260 | 231 | 204 


Find the number of men getting wages between Rs. 10 and 15 from the 
following data: 


0—10 
9 


10—20 
30 


20—30 
35 


30—40 
42 


Wages in Rs: 


Frequency: 


11. 
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From the following data, estimate the number of persons having in- 
comes between 2000 and 2500: 


Income Below 500 | 500-1000 | 1000-2000 | 2000-3000 | 3000-4000 


No. of persons 6000 4250 3600 1500 650 


12. 


13. 


14. 


15. 


16. 


17. 


Construct Newton’s forward interpolation polynomial for the following 
data: 
x: 4 6 8 10 
y: 1 3 8s | 16 


Hence evaluate y for x = 5. 


Find the cubic polynomial which takes the following values: 
y(0) = 1, y(1) =0, y(2) = 1 and y(3) = 10. 
Hence or otherwise, obtain y(4). 

Construct the difference table for the following data: 


X: 0.1 0.3 0.5 0.7 0.9 1.1 1.3 
f (x): 0.003 | 0.067 | 0.148 | 0.248 | 0.370 | 0.518 | 0.697 


Evaluate f (0.6) 


Apply Newton’s backward difference formula to the data below, to ob- 
tain a polynomial of degree 4 in «x: 

x: 1 2 3 4 5 

@ | i ler] yr leila 


The following table gives the population of a town during the last six 
censuses. Estimate the increase in the population during the period 
from 1976 to 1978: 

Year: 1941 1951 1961 1971 1981 1991 


Population: 12 15 20 27 39 52 
(in thousands) 


In the following table, the values of y are consecutive terms of a series of 
which 12.5 is the fifth term. Find the first and tenth terms of the series. 
x: 3 4 5 6 7 8 9 
y: 2.7 6.4 12.5 21.6 34.3 51.2 72.9 
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18. Using a polynomial of the third degree, complete the record given be- 
low of the export of a certain commodity during five years: 


Year: 1989 1990 1991 1992 1993 
Export: 443 384 — 397 467 
(in tons) 


19. Given u,= 40, u, = 45, u, = 54, find u, and u,. 
20. Ifu_,=10,u, =8,u, = 10, =50, find u, and u,. 


21. Given y, =3, y, = 12, y, =81, y, = 200, y, = 100, y, = 8, without form- 
ing the difference table, find A°y0. 


1 


7.4 Central Difference Interpolation Formulae 


In the preceding sections, we derived Newton’s forward and backward 
interpolation formulae which are applicable for interpolation near the be- 
ginning and end of tabulated values. Now we shall develop central differ- 
ence formulae which are best suited for interpolation near the middle of 
the table. 


Ifx takes the values x, — 2h,x,—h,x,,x,+h,x, + 2h and the correspond- 
ing values of y =f(x) are y_,, Y_,, Yo Y)> Yo, then we can write the difference 


table in the two notations as follows: 


iG y lst diff: 2nd diff. 3rd diff. Ath diff. 

“,-2h |y, 
Ay-, (= Ay-,,,) 

x,-h |y, A’y—,(= A’y_,) 
Ay_, (= Ay_,») A*y_, (= A*y_,,) 

an Yo A’y_, (= A’y,) A’y_,(= A*y,) 
Ay, (= Ay,,») A*y_, (= A*y,,.) 

Cth |e, A’y (= A’y,) 


Ay, (= Ay.) 
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7.5 Gauss’s Forward Interpolation Formula 


The Newton’s forward interpolation formula is 


=D) 45 (p—1)(p — 2) 

Yo = Yo t pAyo + C = A? yy + PP ei Ay ape (1) 

We have A’y, — A’y_, =A’ y_, 
i.e., My =Xky +b y, (2) 
Similarly A®y, = A®’y_,+ Aty_, (3) 
At y, = At y_+ A’ y_, ete. (4) 

Also A* Y_y— A*y -2 AY Y 5 

ieé., My =My Ay, 

Similarly Aty_,=Aty_,+ A’ y_,ete. (5) 


Substituting for A’ y,, A® y,, At y, from (2), (3), (4)..in (1), we get 


(p—1) (p—I)(p—2);,. 
Y= Yo + pAyo + © - (Ay, Piya) eo A +A‘y_,) 
plp—lp—2)(p—3)/ 5 
2 12.34 (Ay. +4°y-1) 
w=). =y=2 
Hence y, = yo + pdyy + EP ai Ary PPP Ay, 
_ PtVp (p gy, a [using (5)] 


4| 
which is called Gauss’s forward interpolation formula. 
Cor. In the central differences notation, this formula will be 
ga) 
2) 


(p—D(p—2) .: 
BPP?) 524, 


p= lip=2)p—3) 
4! 


NOTE Obs. 1. It employs odd differences just below the central line 
——— and even difference on the central line as shown below: 


Yp = Yo + pOyrys +! Oya + 2 


4P 


O'Yy2 


Yo A*y _, Aty , A’y_, Central line 


ar 


At 0 A*y A’y_, A’ -3 
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Obs. 2. This formula is used to interpolate the values of y for p 
(0 <p < 1) measured forwardly from the origin. 


7.6 Gauss’s Backward Interpolation Formula 


The Newton’s forward interpolation formula is 


Yn = Yo + pAyo + BPR z A*yy ~ wv =a! =e Ay i a (1) 
We have Ay,-Ay_,=A’y_, 
iLe., Ay,=Ay,t+tAy, 
Similarly Ay ey ey 

Ay, =A’ y_, + A*y_, ete. 

Also A’y_,-A®y_,=A*y, 
i.e., My a Ay AY, 5 
Similarly Aty_,=A*y_,+ A’ y_,ete. 6 


Substituting for A y,, A’ y,, A’ y,,--- from (2), (3), (4) in (1), we get 


| (p-D/,; 
y= Yo + plAy, +A7y_ 1) + (Ay, + A°y_1) 


plp—1)(p-2)/.: (p —1)(p—2)(p —3) 
aeat (A°yy + Aty ))4EE a 


x (Aty_; +A°y_, ) apes 


PPt) j5 (p+1)p(p—-1) 
ee mee ae Le eee 

12° 7 1.2.3 J-1 
g OS ES EE 5A 3 Pee 

1.2.3.4 1.2.3.4 
(p+l)p .5 (a+ Dp) pis 
12 AYy1+ 1.2.3 (A°yo +AYy.s) 
(p+ 1l)plp=1)p=2) 

1.2.3.4 


= yo + pAy_i + 


A’y_) +... 


= yo + pAy_, + 


(Aty_s + A°y_2) + ied 
[using (5) and (6) 
(p +1)p(p -1) 
3! 
pee ip ath 
4! = 
which is called Gauss’s backward interpolation formula. 


(p+) 
Hence yp=yo + pAy. +24 


rT A’y_y + 


A*y_s 


, 
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Cor. In the central differences notation, this formula will be 


(p +1) (p+1)p(p—1) .. 
Yp = Yo + pOy-aja + pe out =, Oe 


n (p + 2)(p +1)p(p—1) 
4! 


O'Yyy ++ 


NOTE Obs. 1. This formula contains odd differences above the central 
line and even differences on the central line as shown below: 


Ay , NY Ay. 
Yo A’y_, Sy 5 A’y_ Central line 
Obs. 2. It is used to interpolate the values of y for a negative 
value of p lying between — 1 and 0. 


Obs. 3. Gauss’s forward and backward formulae are not of 
much practical use. However, these serve as intermediate steps 
for obtaining the important formulae of the following sections. 


7.7 _Stirling’s Formula 


Gauss’s forward interpolation formula is 


(p+), 6 (p+1)p(p-1) ,: 
Yp = Yo + pAyo + SF Y-1 SS 
(1) 
+1 —l)\(p-2 
4 (Pt Dplp — lp MSs ics 
4] 
Gauss’s backward interpolation formula is 
(p+l)p |: (p+1)p(p—1) ,: 
Yp = Yo + pAy-1 oe + eee (2) 
+2)(p+1)p(p—1 
4 Pt 2p + Lplp Neate 
4] 
Taking the mean of (1) and (2), we obtained 
Ay, +A ae 2] 
y= Hot fen Ha), fg SE 
2. 2! 3! (3) 
3 3 27 2 
(4 yt va), _ D) Ady tes 


Which is called Stirling’s formula. 


290 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


Cor. In the central difference notation, (3) takes the form 


Pig Pe Al) on ogre =) 
Yp = Yo + pHdYo +°5, 9 Yo + — HO Yo + 


2 


"Yo +... 
1 1 
For 5 (Avo + Ay_, ) = 5 (oN + dy) = HOY 


1 lf. ’ 
(Oy + A*y_») - 5 (Ou * yy) =Ud°y, ete. 


NOTE Obs. This formula involves means of the odd differences just 


above and below the central line and even differences on this 
line as shown below: 


ra 2 A*ys 4 A’y_ 
YU eee Ary vate ; Aty_oee: 
Yo | AYo Y 1 ie Y 2 AP 


Yo 


A®y ge 


Central line. 


7.8 Bessel’s Formula 


Gauss’s forward interpolation formula is 


—1).; +1 -l 
uy, = Yo + pay ee A gone! 


a 33 
Pt Vpp- WPF) ya, 
4! Y-9 

We have A’y, — A’y_, = A*y_, (1) 
i.e., Ay ,=A’y,-A’y, (2) 

Similarly A*y_, = A’y_, — A’y_, ete. 

Now (1) can be written as 

RPV Liae Leg pp —1) 

Yp = Yo + PAY +5; [Fat +5 Mya lt Ay 


2 — 
Pip Wp 25 ee A'y.»] — 
4! ge ee 


lp(pt+l) |. 1 p(p-1)/,:; 
= yy t pAyo + OS +" a (Ay +A°y_;) 


2 2 
pp —}) j3 1 pip —l)(p—2) ,4 
a fats 4! ae 


(Ay, Aky.) 


1 pip” —1)(p—2) 
y) 4! 


[Using (2), (3) etc.] 
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1 
p(p-1) A*y 7 A’ yo + (» = 5p me 


Hence , = 3 4 
ence Yp = Yo + pAyy + ry 5 7 A°y_, (4) 
Which is known as Bessel’s formula. 
Cor. In the central difference notation, (4) becomes 
1 
=— ipo) 
plp-V) 9s 3)? | 
Yp = Yo + Poyyja ts — HO Yrs + 7 OY 
(p + 1)p(p — 1)(p — 2) 
,etDp Po a ee 


for s(A%y + A?y))= 13*yy0.5(Ay-s +A4y_1)=p0yy ete., 
NOTE Obs. This is a very useful formula for practical purposes. It 
involves odd differences below the central line and means of 
even differences of and below this line as shown below 
Yo A’y-1 Py A®y_, Central line 
Ayo Ay, A’ys A’y-s ; 
Ayo A‘y. ANY 


7.9 Laplace-Everett’s Formula 
Gauss’s forward interpolation formula is 
(p= Up o3 (p+1)p(p—-1) |: 
Yn = Yo + pAyo + C oT L A*y_ fo 
(p + 1)p(p —1)(p— 2) (p + 2)(p + 1)p(p — 1)(p — 2) 
4| 5! 
We eliminate the odd differences in (1) by using the relations 


(1) 


x A°y_) +e 


+ A*y_9 + 


Ayo = 1 - 5 Ys = A’ yo = A’y_,,A°y 2 > A*y = A* ys etc. 


Then (1) becomes 


(p—]) ,¢ (a+ l)plp—1)7 , 4 2 
Y= Yo + P(t — Yo to i A*y_, +b (a Yo —A°y-1) 


+1)p(p—-1)(p—-2 +2)(p+1)p(p—1)(p-2 
p a a=2) ins +P \(p Lt p=2) 
x(Aty_, —Aty_9) ++ 


i 
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plp—W(p-2) ,2 (p+1)p(p—-1) 


=(1—p)yo + py ae Y-1 ne 
_ (p+ Vplp— (p= 2)(p 3) 
5! - 
+2)(pt+ 1 1 2 
4 (Pt2Np fee Mp=2) me 


To change the terms with negative sign, putting p = 1 —q, we obtain 


2 42 272), 2 92 
OED 8p OT tes 


Yn = Wo t 3] -1 5! 


(p'-1") ,2 
tpy + Ayo + 7 Myag he: 


This is known as Laplace-Everett’s formula. 


NOTE Obs. 1. This formula is extensively used and involves only even 


differences on and below the central line as shown below: 


Yo Ay, Aty, A’y_,Central line 


tn My ty AP 


Obs. 2. There is a close relationship between Bessel’s formula 
and Everett’s formula and one can be deduced from the other 
by suitable rearrangements. It is also interesting to observe that 
Bessel’s formula truncated after third differences is Everett's 
formula truncated after second differences. 


7.10 Choice of an Interpolation Formula 


So far we have derived several interpolation formulae such as Newton’s 
forward, Newton’s backward, Gauss’s forward, Gauss’s backward, Stirling’s, 
Bessel’s and Everett’s formulae for calculating y,, from equispaced values 
which are called classical formulae. Now, we have to see which formula 
yields most accurate results in a particular problem. 


The coefficients in the central difference formulae are smaller and 
converge faster than those in Newton’s formulae. After a few terms, the 
coefficients in the Stirling’s formula decrease more rapidly than those of 
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the Bessel’s formula and the coefficients of Bessel’s formula decrease more 
rapidly than those of Newton’s formula. As such, whenever possible, central 
difference formulae should be used in preference to Newton’s formulae. 


The right choice of an interpolation formula however, depends on the 
position of the interpolated value in the given data. 


The following rules will be found useful: 


1. To find a tabulated value near the beginning of the table, use Newton’s 
forward formula. 


2. To find a value near the end of the table, use Newton’s backward for- 
mula. 


3. To find an interpolated value near the center of the table, use either 
Stirling’s or Bessel’s or Everett’s formula. 


If interpolation is required for p lying between = and = prefer Stirling’s 
formula = 7 


1 3 
If interpolation is desired for p lying between ri and re use Bessel’s 
or Everett’s formula. 


EXAMPLE 7.7 
Find f(22) from the Gauss forward formula: 


Xi: 20 25 30 35 40 45 
f(x): | 354 332 291 260 231 204 


Solution: 


Taking x, = 25, h =5, we have to find the value of f(x) for x = 22. 


x=9 22,—25 
i.e., for pats 5 =-— 0.6 
h 
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The difference table is as follows: 


x p Y, » | Sy, | My, | Ay, | Ay, 
20 = Badeg.) || 22 
25 0 B32(=y,) | -41 | -19 | 29 
30 1 91 (=y,) =a 10 he | 87 45 
35 2 60 (=y,) — 29 2 0 8 
40 3 231 (=y,) ~27 2 
45 4 204 (=y,) 
Gauss forward formula is 
(p=1) 9 (p + 1)p(p—1) 
Yp = Yo + pAyo +2 SF A*y_, +p ay 
+1)p(p—-1)(p-2 
4? )p(p — 1)(p LAty 5 
4) 
+1)(p—l)plp—2)(p +2 
4 P )(p —1)p(p — 2)(p Te _ 
5! 
+f (22) = 332 + (0.6)(—41) + oo “VK19) 
n (-0.6 +1)(- O6KC 0.6-1) (8) 
—0.6 +1)(—0.6)(—0.6 — 1)(-0.6 — 
ot \( aa 1)(-0.6 2) _ 37) 
—0.6 + 1)(—0.6)(—0.6 — 1)(—0.6 — 2)(-0.6 +: 
an )(-0.6)( 1)(—0.6 — 2)( 0.6 +2) (45 


5| 
= 332 + 24.6 — 9.12 — 0.512 + 1.5392 — 0.5241 
Hence f (22) = 347.983. 


EXAMPLE 7.8 


Use Gauss’s forward formula to evaluate y,,, given that y,, = 18.4708, 
a= 17.8144, yy, = 17.1070, y,, = 16.3432 and y,. = 15.5154. 


Solution 


29 


Taking x, = 29, h = 4, we require the value of y for x = 30 


X—-Xy 30-29 | 
h + 


i.e.,for p= 0.25 
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The difference table is given below: 


x p Y,, Ay, A*y, A*y, A’y, 
21 —~2 | 18.4708 
~ 0.6564 
25 —1 | 17.8144 ~ 0.0510 
~ 0.7074 — 0.7074 
29 0 | 17.1070 — 0.0564 — 0.0022 
~ 0.7638 — 0.0076 
33 1 | 16.3432 — 0.0640 
— 0.8278 
37 2 | 15.5154 


Gauss’s forward formula is 


1) 


(a1) 5 (p+1)p(p-l) .. 
Y= Yo tpAyy +P S A*y_, + 
+1)p(p—-1)(p-2 
4 )p(p —1)(p Lp cas 
1.2.3.4 2 


0.25)(—0.75 
Y39 = 17.1070 + (0.25) (-0.7638) + Cnr 0 (0.0564) 


z Je (0.0076) + Je 1.75) 


x(—0.0022) 
= 17.1070 — 0.19095 + 0.00529 + 0.0003 — 0.00004 = 16.9216 approx. 


EXAMPLE 7.9 


Using Gauss backward difference formula, find y (8) from the following 
table. 


x 0 5 10 15 20 25 
y 7 11 14 18 24 32 
Solution: 


Taking x, = 10, h =5, we have to find y for x = 8, i.e., for 
—_x—xXy 8-10 _ 


h 5 


0.4. 
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The difference table is as follows: 


x p Y, Ay, A’y,, A*y, A‘y, A’y,, 
0 2 7 
4 
5 1 11 -l1 
3 2 


25 3 32 


Gauss backward formula is 


+1)p (p +1)p(p— 1) 


Yp = Yo + pay, Be a y-t 3) 2 
aoe Eee sn oe 
y(8) = 14 +(-0.4)(3) + (-0.4 yt ()+ (-0.4+ ae -1) (2) 
ri (—0.4 + 2)(—0.4 + 1)(—0.4)(—0.4 — 1) (-1) 


4) 
= 14-1.2-0.124+0.1124+ 0.034 
Hence Ye) = 12.826 


EXAMPLE 7.10 


Interpolate by means of Gauss’s backward formula, the population of a 
town for the year 1974, given that: 


Year: 1939 1949 1959 1969 1979 1989 
Population: 12 15 20 27 39 52 
(in thousands) 


Solution: 
Taking x, = 1969, h = 10, the population of the town is to be found for 
_ 1974-1969 _ 
P= 


0.5 


The Central difference table is 
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x p y, | Ay, | A’y, | A’y, | A’y, | A’y, 
1939] -3 | 12 3 2 0 3 -10 
1949] -2 | 15 

5 
1959} -1 | 20 2 
q 3 
1969} 0 | 27 5 27 
12 4 
1979 1 | 39 1 
13 
1989} 2 | 52 
Gauss’s backward formula is 
(p+Dp ,2 (p+1)p(p-l) ,: 
Yn = Yo + pAy_; +, A +, A’y-s 
+2)p(p + 1)p(p—-1 
x (p + 2)p(p + 1)p(p — 1) Aty 5 
4) 
+ 2)(p +1)p(p—1)(p—2 
6 (p + 2)(p vale \(p By, ps 


Yos = 27 +(0.5)(7) + C5N0°) (5) + CONOSNCOS) 


4 (2.5)(1.5)(—0.5) (-7)+ (2.5)(1.5)(0.5)(—0.5) (1.5) (-10) 
24 120 
= 27+ 3.5 + 1.875 — 0.1875 + 0.2743 — 0.1172 
= 32.532 thousands approx. 


EXAMPLE 7.11 
Employ Stirling’s formula to compute y,,, from the following table 
(y, =1 + log, sinx): 
x 10 11 
10°: 23,967 28,060 


x 


12 
31,788 


13 
35,209 


14 
38, 368 
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Solution: 


Taking the origin at x, = 12°, h = 1 and p =x — 12, we have the following 


central difference table: 


; 2, 3, 4 
Pp Y, Ay, A’y, A’y, A’y, 
-2=4, 0.23967 =y_, 
0.04093 = Ay_, 
== X_, 0.28060 = Yy_, — 0.00365 = A2y_, 
0.03728 = Ay, 0.00058 = A’y_, 
0=x, 0.31788 = y, — 0.00307 = A’y_, — 0.00013 = Aty_, 
0.03421 = Ay, — 0.00045 = Ay, 
l=x, 0.35209 = y, — 0.00062 = A*y, 
0.03159 = Ay, 
2=n, 0.38368 = y, 


Atx = 12.2, p = 0.2. (As p lies between = and 
formula will be Quite suitable.) 
Stirling’s formula is 


2 


1 
ve the use of String’s 


_  pAy-rtAyo P ys , Pp al) A®yatA®y1 
Yp=Yot To FA eat a 2 
27.2. 
Pp (p —l) 4 
17 A’y_, ++ 
When p = 0.2, we have 
Yoo = 0.3178 + 09205728 sf = + 2) (—0.00307) 
(0.2)"| (0.2)° -1 : (0.2)"| (0.2) -1 
: [ cos + 2.00054 [ Ie ney 
6 2 24 
= (.31788 + 0.00715 — 0.00006 — 0.000002 + 0.0000002 
= (0.32497. 
EXAMPLE 7.12 
Given 
0°: 0 5 10 is 20 25 30 
tan 0: 0 0.0875 0.1763 0.2679 0.3640 0.4663 0.5774 
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Using Stirling’s formula, estimate the value of tan16°. 


Solution: 


Taking the origin at 0° = 15°, h =5° and p= 6-15 We have the follow- 
5 ? 


ing central difference table: 


p | y=tand Ay A’y A*y Aty A’y 
—3 | 0.0000 
0.0875 
—2 | 0.0875 0.0013 
0.0888 0.0015 
—1 | 0.1763 0.0028 0.0002 
0.0916 0.0017 — 0.0002 
0 | 0.2679 0.0045 0.0000 
0.0961 0.0017 0.0009 
1 | 0.3640 0.0062 0.0009 
0.1023 0.0026 
2 | 0.4663 0.0088 
0.1111 
3 | 0.5774 
At = 16°, p= 1 3 


Stirling’s formula is 
2 


p(p —1) A*y_s + A°yy 


ae p Ay_ + Ayo P42 
Yp Yo * 7 a Tat ¥ait 3 2 
2, 2 
= 1 
oP F Lie cdhen 


+ 8 (0.0045) +--- 


0.0916 + 0.0916 
*. Yo = 0.2679 + 02 ; 


= 0.2679 + 0.01877 + 0.00009 + --- = 0.28676 
Hence, tan 16° = 0.28676. 


EXAMPLE 7.13 


Apply Bessel’s formula to obtain y,., given y,, = 2854, y,, = 3162, 


Yo, = 3544, y,, = 3992. 
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Solution: 
Taking the origin at x, = 24, h = 4, we have p = (x - 24). 


.. The central difference table is 


Pp y Ay A’y A’y 


308 


Zz 3992 


25 —24 1 
225524) 21 (As p lies hetwoen and el ,the use of 
4 4 4 4 


Bessel’s formula will yield accurate results) 


At x=25,p 


Bessel’s formula is 
P\pP— A + P : Pp- 1 
(p 1) "yy A*yo 9 pl ) 


2! 2 2! 
When p = 0.25, we have 


Yn = Yo + pAyo + A®y_, 4... (1) 


0).25(—0.75) (74 + 66 0.25)0.25(—0.75 
y, = 3162 + 0.25 x 382 + J+ ) )_g 


2! 2 2! 
= 3162 + 95.5 — 6.5625 — 0.0625 
= 3250.875 approx. 


EXAMPLE 7.14 
Apply Bessel’s formula to find the value of f (27.5) from the table: 


Xe 25 26 27 28 29 30 
Kx): | 4.000 | 3.846 | 3.704 | 3.571 | 3.448 | 3.333 


Solution: 


Taking the origin at x, = 27, h = 1, we have p =x — 27 
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The central difference table is 


x p y Ay A’y A*y A’y 
25 ~2 | 4.000 
-0.154 
26 -1__| 3.846 0.012 
~ 0.142 — 0.003 
27 0 3.704 0.009 0.004 
0.133 0.001 
28 1 3.571 0.010 0.001 
— 0.123 — 0.002 
29 2 3.448 0.008 
— 0.115 
30 3 3.333 


At x = 27.5, p = 0.5 (As p lies between 1/4 and 3/4, the use of Bessel’s 
formula will yield an accurate result), 


Bessel’s formula is 


1 
2 2 =" |p@=1) 
p(p—1) A®y_, +A’y (» 5)? | 
Yp = Yo + PAyo +> eat A A*y_ 
Pt Delp —Dip=2)/ Aty-g + Ay | 
4! 2 
When p = 0.5, we have 
4p=3.704— (0.5)(0.5— ae ae : 
2 2 
(05 +1)(0.5)(0.5~1)(0.5— 2) (~0.001 ~ 0.004) 
2 2 


= 3.704 — 0.11875 — 0.00006 = 3.585 
Hence f (27.5) = 3.585. 


EXAMPLE 7.15 


Using Everett’s formula, evaluate (30) if f(20) = 2854, f(28) = 3162, 
f(36) = 7088, f(44) = 7984 


Solution: 


x — 28 


Taking the origin at x, = 28, h = 8, we have p=- _ The central table 


is 
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NG y Ay A’y A*y 
20 ae | 2854 
308 
28 0 3162 3618 
3926 — 6648 
36 1 7088 — 3030 
896 
44 2 7984 
At iis es and q=1—p=0.75 
Everett’s formula is 
2 42 2 _ 42/92 _ 92 
Yp = qyo + qq 31 A*y_4 + q4 = Myo +... 
2 42 2 49,, 2 92 
= = \(p" =2 
+py, + PA 3 Ady, + PAP ‘ ty s ck 
0.75(0.75" —1 
= (0.75) +(3162) + 20? —" (3618) tee 
0.25(0.25° — 1) 
+0.25 +(7080) + 3 (3030) fe 
= 9371.5 — 351.75 + 1770 + 94.69 = 3884.4 
Hence f (30) = 3884.4 
EXAMPLE 7.16 
Given the table 
310 320 330 340 350 360 
log x: | 2.49136 | 2.50515 | 2.51851 | 2.53148 | 2.54407 | 2.55630 
find the value of log 337.5 by Everett’s formula. 
Solution: 
x — 330 


Taking the origin at x, = 330 and h = 10, we have p= 
10 
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“. The central difference table is 


p y Ay A*t A*y A‘ty A*’y 
—2 2.49136 
0.01379 
-l 2.50515 — 0.00043 
0.013836 0.00004 
0 2.51881 — 0.00039 — 0.00003 
0.01297 0.00001 0.00004 
1 2.53148 — 0.00038 0.00001 
0.01259 0.00002 
2 2.54407 — 0.00036 
0.01223 
3 2.55630 
To evaluate log 337.5, i.e., for x = 337.5, p= ae 0.75 


(As p > 0.5 and =0.75, Everett’s formula will be quite suitable) 


Everett’s formula is 
5! 


272) 2 _ 12) (n2 —92 
pl ) A2y, " p(p \(p ) 
3! 5! 


0.25 (0.0625-1) 
6 


gig =l) he 
Yp = Yo F 3) A Y-1 + 


A*y_» +... 


A*y_, +... 


+py, + 
= 0.25 X 2.51851 + x (0.00039) 


,, 0.25 (0.0625-1)(0.0625-4) ny 


120 
+0.75 X 2.53148 + ad x (—0.00038) 
0.75(0.5625 — 1)(0.5625 — 4) 
+ 7 x (—0.00001) 


= 2.62963 + 0.00002 — 0.0000002 + 1.89861 + 0.00002 + 0.0000001 
= 2.52828 nearly. 
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Exercises 7.2 


1. Find they (25), given that y,, = 24, y,, = 32, y,,=35, y,, = 40, using Gauss 
for ward difference formula. 


2. Using Gauss’s forward formula, fin d a polynomial of degree four which 
takes the following values of the function f (x): 


3. Using Gauss’s forward formula, evaluate f(3.75) from the table: 


oe 2.5 3.0 3.5 4.0 4.5 5.0 
Y: 24.145 | 22.043 |} 20.225 18.644 17.262 16.047 
4. From the following table: 
x: 1.00 1.05 1.10 1.15 1.20 1.25 1.30 
e: 2.7183 | 2.8577 | 3.0042 | 3.1582 | 3.3201 | 3.4903 | 3.6693 


Find e'"’, using Gauss forward formula. 
5. Using Gauss’s backward formula, estimate the number of persons 
earning wages between Rs. 60 and Rs. 70 from the following data: 
Wages (Rs.): Below 40 40—60 60—80 80—100 | 100—120 


No. of persons: 250 120 100 70 50 
(in thousands) 


6. Apply Gauss’s backward formula to find sin 45° from the following table: 


O°: 20 30 40 50 60 70 80 
sin 8: | 0.34202 | 0.502 | 0.64279 | 0.76604 | 0.86603 | 0.93969 | 0.98481 


7. Using Stirling’s formula find y,., given y,, =512, y,, = 439, y,, = 346, 
Y<) = 243, where y, represents the number of persons at age x years in a 
life table. 

8. The pressure p of wind corresponding to velocity v is given by the fol- 
lowing data. Estimate p when v = 25. 

; Vv: 10 20 30 40 

Pp: 11 2 4.4 7.9 


10. 


11. 


12. 


13. 


14. 


15. 


16. 
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. Use Stirling’s formula to evaluate f(1.22), given 


x: 1.0 1.1 1.2 1.3 1.4 
fix): | 0.841 0.891 0.932 0.963 0.985 
Calculate the value of f (1.5) using Bessels’ interpolation formula, from 
the table 
Xs 0 1 2 3 
Kx): 3 6 12 15 


Use Bessel’s formula to obtain y,., given y,, = 24, y,, = 32, y,.=35, 
Ys9, 7 40. 

Employ Bessel’s formula to find the value of F at x = 1.95, given that 
om 1.7 1.8 1.9 2.0 2.1 2.2 2.3 
F: 2.979 | 3.144 | 3.283 | 3.3891 | 3.463 | 3.997 | 4.491 


Which other interpolation formula can be used here? Which is more ap- 
propriate? Give reasons. 


From the following table: 


xX: 20 25 30 35 40 
fix): | 11.4699 | 12.7834 | 13.7648 | 14.4982 | 15.0463 


Find (34) using Everett’s formula. 


Apply Everett’s formula to obtain u 
Uy, = 3044, u,, = 3992. 


ov given Uy) = 2854, Uy,= 3162, 
Given the table: 


: 310 320 330 340 350 360 
logx: | 2.4914 | 2.5052 | 2.5185 | 2.5315 | 2.5441 | 2.5563 


Find the value of log 337.5 by Gauss, Stirling, Bessel, and Everett’s 
formulae. 


If Yo. Yi> Yo Yy Vp Ys (y; being constant) are given, prove that 


3(a—c)+2.5(c—b) | ¢ where a= yy +y5,b=y, +y4,0 = Yo + Y3- 
256 2 


[HINT: Use Bessel’s formula taking p = 1/2.] 


Y5/2 = 


306 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


7.11 Interpolation with Unequal Intervals 


The various interpolation formulae derived so far possess the disadvan- 
tage of being applicable only to equally spaced values of the argument. It is, 
therefore, desirable to develop interpolation formulae for unequally spaced 
values of x. Now we shall study two such formulae: 


(i) Lagrange’s interpolation formula 


(ii) Newton’s general interpolation formula with divided differences. 


7.12 Lagrange’s Interpolation Formula 


If y =f(x) takes the value y,, y,,......, y, corresponding tox =x,x,,+++, % 
then 


f(x)= 


Vv 


=) T= %5) =e) ne (=o) =a) S a) 
(xy =X )(Xp —Xo)e(Xp— Hy)? (ay — Ay Nay — Ky) (4, — X,) 
(6 = 15 =o) = 2, <4) 
(x, Xo MX, — Xp) (X,, — X41 

This is known as Lagrange’s interpolation formula for unequal inter- 
vals. 


"1 
(1) 


oor © 


Yn, 
yt 


Proof: Let y = f(x) be a function which takes the values (x,, y,), (X) Y,).-7* 
(x, y,,): Since there are n + 1 pairs of values of x and y, we can represent f(x) 
by a polynomial in x of degree n. Let this polynomial be of the form 


y = f (x) =ag(x —x,)(x-Xy)...(x—x,) Fay (x —Xy)(X— XQ): -(X—-X,,) 
Fay ky (ey eae, ere ae, eh, (nay amy rina, 4) (2) 
Putting x =x,, y = y,, in (2), we get 
Yo = Ay (Xp — x1 )(x — Xq)+++(x—X,,) 
Ay = Yo /[(x—xy)(x—Xg)-(x—x,,)] 


Similarly putting x =x,, y = y, in (2), we have 


a =Y, /[(xy =X Mx} = X5)+0+(4y —x,)] 


Proceeding the same way, we find a,, a,...... d,. 


n 


Substituting the values of a,, a,,---, a, in (2), we get (1) 


INTERPOLATION © 307 


NOTE Obs. Lagrange’s interpolation formula (1) for n points is a 
polynomial of degree (n — 1) which is known as the Lagrangian 
polynomial and is very simple to implement on a computer. 


This formula can also be used to split the given function into 
partial fractions. 
For on dividing both sides of (1) by (x —xy)(x—x)++-(x—x,), we 
get 

f(x) Yo poe 


(xXx xy )-(x—X_) — (Xq — Hy xq — %g)++-(%q —X,) (XX) 


EXAMPLE 7.17 


Given the values 


oe > 7 11 13 17 
x): 150 392 1452 | 2366 | 5202 


evaluate f(9), using Lagrange’s formula 


Solution: 


(i) Here x, =5,x,=7,x, = 11, x,=18,x,=17 
and y, = 150, y, = 392, y, = 1452, y, = 2366, y, = 5202. 


Putting x = 9 and substituting the above values in Lagrange’s formula, 


we get 
(9 -7)(9 -11)(9 -13)(9 -17) (9 —5)(9-11)(9-13)(9-17) 
f)= S162 135217)” * @=a\T AIT 2137217) 
(9-5)(9-7)(9- 139-17), 
(11 —5)(11—7)(11 — 13)(11—17) 
(9-5)9-7)9- 19-17) gaa 
(13—5)(13—7)(13—-11)(3—17) 
(9-5)(9-7)(9-11)9-13) 
(17 —5\(17 717 117 — 13) 
50 3136 3872 2366 578 
=" 4 +p 4 P= 810 


3 15 3 3 5 


308 © Numerical METHODS IN ENGINEERING AND SCIENCE 


EXAMPLE 7.18 


Find the polynomial f (x) by using Lagrange’s formula and hence find 
f(3) for 


x: 0 1 2 5 
f: | 2 3 12 | 147 
Solution: 


Here x, =0,x,=1,x,=2,%,=5 
and Y, = 2, Y, =3, yy = 12, y,=147. 


Lagrange’s formula is 


_ (x= x1 )(x = Xy )(x — x3) (x — Xp (x — x9 (x — x5) 
F % — Ney —Ha)(%y — Hy)?” (= Ry) — aOR — 4) 
(ety ee ams) (L= Hye =H = ey) ; 

(iy — xy )(&_— Vly 5)? | (xy — Hy) — mV He)” 

_ (= Dlx= 2x = (2) 4 (a) 

(0—1)(0—2)(0—5) (1—0)(1—2)(1-5) 

race e=O0)e=Die= >) + >) 147) 
(2-0)(2-1)(2- (5 —0)(5—1)(5—2) 


Hence f(x)=x? +07 —x +2 
f(3)=274+9-34+2=35 


EXAMPLE 7.19 
A curve passes through the points (0, 18), (1, 10), (3, -18) and (6, 90). 
Find the slope of the curve at x = 2. 
Solution: 
Here x) =0,x, =1,x, =3,x3 =6and yy) =18,y, =10,y, =-18,y; = 90. 


Since the values of x are unequally spaced, we use the Lagrange’s for- 
mula: 


=i) eR) R= a5) (x — Xo (x — x5 )(x — x5) 


ig —m Ng a) ap —t9) 2? * Gey ag), = tg lq —) 
(C= = 95 = x3) — (=i) ) c= a = xg) ; 
(%_ — Xp)M(xX_ — X)(xX_ — x3) : (x3 — X)(x3 — )(tty — 4) 2° 
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_ (x~1)(x-3)(x-6 48) + (x —0)(x —3)(x — 6) 
(0 -1)(0-—3)(0 —-6) = 0)0= et 


(© Oe NEB) (_pgy , (OMe 
(3-0)8-NG-6) (6=0)(6-1N6—3) 
) 


=(-x? +10x? — 27x +18) +(x? — 9x? +18x 
+(x? — 7x7 +6x) +(x? — 4x? +32) 
ie, y= 2x° — 10x? +18 
Thus the slope of the curve atx =2= (<4) 
= (6x? —20x),_» =—16 a 


EXAMPLE 7.20 
2 7 
Using Lagrange’s formula, express the function ea as 
a sum of partial fractions. (x -1)(x-2)(x—3) 


Solution: 
Let us evaluate y = 3x7 +x +1 forx=1,x=2andx=3 


These values are 


x: X,=1 | x,=2 =3 


y: Y=S fy, =15 | y, =31 
Lagrange’s formula is 


(x= 4 )(x— x9) (x= 2X )(x — X9) (x= )(x— 24) 


_ (Xo =H Xe =a) Yo * (xy a Xo (xy a Xp) 


Substituting the | ~ we get 
_ _ (x —2)(x - a )+ —1)(x -3) (45) +S -—Dix- 
ET ie 2\(1- = 1)(2-3) -1)(3- 


= 2.5 (x b. 3)-15 (x-1) &x eee 


2.5 (x — 2) (x —3)-—15(x —1) (a -3) + 
Thas 3x7 +x41 7 15.5 (x—1) (x-2) 
(x — 1)(x — 2)(x — 3) (x — 1)(x — 2)(x — 3) 
25 15 : 15.5 


x-l x-2 x-38 
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EXAMPLE 7.21 


Find the missing term in the following table using interpolation: 


xz | o|]1]2i{]3 ii 4 
y | 1 | 3 | 9 |. | 81 


Solution: 
Since the given data is unevenly spaced, therefore we use Lagrange’s 
interpolation formula: 
— (Xa MEAs) _(W= Xo (x= XQ)(x = 45) 
(Xq —Xy )(Xq “Kg )(Xq 5) ° (ary = Xq)(%y — Xq )(x, — X3) ' 
xy ee ee) (Gay t= oe) 


(X_ — Xp )(%_— x )(Xg =x)? : (x3 — Xo )(X3 — x1 )(xX3 — Xq) : 


Here we have x» =0 x,=1 x,=2 x,=4 


_ eee jg ee 
—1)(0-—2)(0-4) (1—0)(1—2)(1- 4) 
e=Oie= Des) (x= 0)(x-— 1) —2) 

‘enoe-nes4* aaoyaa nasa) 

When x = 3, then 
= (3-1) 5-216- 4) pas oy Sadd 3(3- Ne 4)(9) ae 
gO SUSE) give 1 ata 27 2 81 = 3] 
24 4 2 24 


Hence the missing term for x = 3 is y = 31. 


EXAMPLE 7.22 


Find the distance moved by a particle and its acceleration at the end of 
4 seconds, if the time verses velocity data is as follows: 


t: 0 1 3 4 
Vv: 21 15 12 10 
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Solution: 
Since the values of t are not equispaced, we use Lagrange’s formula: 
ss (t—t, (t — t,)(t — ts) i (t —ty)(t —ty )(t - ts) 
(fo —ty)(ty —ta)lty —ts) (ty —to M(t, ty )(ty - ts) 
a (tty )t—t)t—ts) (f£—ty)E—t))E—t3) _ 
(t) — ty (t, — ty )(t, — ts) (t) — ty )(t, —ty)(t) — ts) 


1 


‘ ¢-1)¢-3)¢—4),.,,, £—-3)(t—A4) 
a 2 nV 
t(t — 1)(t — 4) t(t —1)(t-3) 

2, 
Racy ?* waa 0 


ie., v= —5t® + 38¢7 — 105° +252) 


4 4, : ds 
.. Distance moved s = it. odt = J, (5t? + 3817 — 105’ + 252) Ei v= A 


4 


+ 252t 
3 2 


| 
12 
0 

1 


2432 


—320 + —— — 840 + 1008) = 54.9 


[20 38t° 105? 
+ 

4 

(-s20475 


“12 
» 1 
Also acceleration =—= mo 15t2 + 76t — 105 +0) 
1 
Hence acceleration at (¢ = 4) = no 15++76(4)—105) =— 


Exercises 7.3 


1. Use Lagrange’s interpolation formula to find the value of y when x = 10, 
if the following values of x and y are given: 

x 5 6 9 ll 

ye | i2-|- 0s | 4 | fe 


2. The following table gives the viscosity of oil as a function of tempera- 
ture. Use Lagrange’s formula to find the viscosity of oil at a temperature 
of 140°. 


Temp?*: 110 130 160 190 
Viscosity: 10.8 8.1 5.5 4.8 


10. 


11. 


12. 


. Given log, 654 = 2.8156, log,, 658 = 2.8182, log, 659 = 2.8189, 


log, 661 = 2.8202, find by using Lagrange’s formula, the value of 
log,, 656. 


. The following are the measurements T made on a curve recorded by 


oscilograph representing a change of current I due to a change in the 
conditions of an electric current. 


T: 1.2 2.0 2.5 3.0 
L: 1.36 | 0.58 | 0.34 | 0.20 


Using Lagrange’s formula, find I and T = 1.6. 


. Using Lagrange’s interpolation, calculate the profit in the year 2000 


from the following data: 


Year: 1997 1999 2001 2002 
Profit in Lakhs of Rs: 43 65 159 248 


. Use Lagrange’s formula to find thee form of f(x), given 


0 2 3 6 
648 704 729 792 


x: 


fix): 


. Ifv(1) =— 3, v(3) = 9, (4) = 30, (6) = 132, fin d the Lagrange’s interpola- 


tion polynomial that takes the same values as y at the given point s. 


. Given f(0) =— 18, (1) = 0, 3) = 0,5) =— 248, f6) = 0, 9) = 13104, 
find f(x). 
. Find the missing term in the following table using interpolation 
x: 1 2 4 5 6 
y | 4[i [5 |... [9 
2 I 
Using Lagrange’s formula, express the function a asasum 
of partial fractions. x? — 2x7 —x +2 
oY +6c-1 
Using Lagrange’s formula, express the function x + 6x as 


x? —1)(x—4)(x—6) 
a sum of partial fractions. (x )e x= 6) 


[Hint. Tabulate the values of f(x) =x? + 6x — 1 forx=—1, 1, 4, 6 and apply 
Lagrange’s formula. ] 


Using Lagrange’s formula, prove that 


1 1j1 1 
=H tya)=He(0+n)-Fy-a+y-a)} 


[Hint: Here x, =— 3, x, =— 1, x, =1, x, =3.] 
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7.13 Divided Differences 


The Lagrange’s formula has the drawback that if another interpola- 
tion value were inserted, then the interpolation coefficients are required 
to be recalculated. This labor of recomputing the interpolation coefficients 
is saved by using Newton’s general interpolation formula which employs 
what are called “divided differences.” Before deriving this formula, we 
shall first define these differences. 


If (x9, Yo)s(*1,Y1),(%9,Yo)."** be given points, then the first divided dif- 
ference for the arguments x,, x, is defined by the relation [x,, x,] or 


17 Yo 
Ay, = 
= Yo rs 
Similarly [x,,x,] or Ay = #81 ond [x,,x,] or Ayy = Ys ~ Ya 
7 *2 tq ~ Xy ~ X3 Xa — Xo 


The second divided difference for x,, x,, x, is defined as 


2 _ [%,%2]—[x9.%4] 
[Xo Xp %,] or AW = 
*1 9% X ~ Xo 


The third divided difference for x 


[xy > Xo.X3 ] a [xo »X1, x9] 


yy Xp» X,, X, is defined as 


ee ae ee 8 0S ay Yo = 
> 4 X]5Xq,X3 Ny — Xo 
Properties of Divided Differences 
I. The divided differences are symmetrical in their arguments, i.e,. inde- 
pendent of the order of the arguments. For it is easy to write 
otf 
XTX XT XO 
Yo Y1 


= x 4 Yo 
(xq — a )(%q XQ) — (XX May — XQ) (XQ = Xq)(XQ — my) 


[x1 ]= =|91%5 Ll tas 2st | 


x,] and so on 


=[x, x, x,] or [x, Se 


II. The nth divided differences of a polynomial of the nth degree are con- 
stant. 

Let the arguments be equally spaced so that 
x, =h. Then 


XX HXy Hy SH =H, 
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A 
[ Xp, mJ=4 1 = 


[x iy %]= a [x - cil 1 JAy, — Ayo 
0X 1>X ~ Oh 


Ny — Xo h h 


=a A’y, and in general, [x9,%1,%,...05%,]= =; —— A" yo 


If the tabulated function is a nth degree polynomial, then A’y, will be 
constant. Hence the nth divided differences will also be constant 


III. The divided difference operator A is linear 


i.e., A{au, + bv, }=aAu, + bAv, 
au, +bv, )-(au, +bv, 
We have A(au, aa bv, )= ( xy xy ) ( Xo Xo ) 
x Xo Xo Xx} — Xp 
maf a Ux, ae 7 Px, | 
1 ~ Xo X17 Xo 
=aAu, +bAv, 
ba aD 


In general A(au, +bv,)=aAu,+bAv, This property is also true for 
higher order differences. 


7.14 Newton’s Divided Difference Formula 


Let y,, y,,"*+y,, be the values of y =f(x) corresponding to the arguments 
x,,x,,---,x.. Then from the definition of divided differences, we have 
0 1 n 


[xx ]= YT Yo 


L=Xy 

Botha y= Yo +(x x) 240 ] 

Again [ x, 29,2, |= Lx%o}-[%o.m ] 
t= Hi 


which gives [x,x9]=[x9,x,]+ (x —,)[x,x9,%) ] 
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Substituting this value of [x, x,] in (1), we get 
Y= iy te = % ity tl me ee | (2) 
[x.x9 x, ]—[x.x9 x5] 


X— Xo 


Also [tests = 


which gives [x,x9,%]=[%,%1,%2] + (x — x2 )[X,%9,%1,%2] 


Xy) 
Substituting this value of [x, x,, x,] in (2), we obtain 
Y = Yo +(x — x )[x 9,41] + (x — xq (x — xy )LX9,41,%5 ] 
+(x — x9 (x — x1 (x — Xq)[x,% 95%] 5X | 
Proceeding in this manner, we get 
Y = Yo +(x — Xp )[Xq.Xy] +(x —Xy)(xX— xX, )LXp,.1, Xo] 
+(x —x9)(x—x,)-+-(x—x,, )[X,%9,%1,°7°X, | 
+(x =X (x — x1 (x — X59) [X,%9,%1, XQ] °° (3) 


which is called Newton’s general interpolation formula with divided 


differences. 


7.15 Relation Between Divided and Forward Differences 


If (Xo, Yo).(%1,Y1),(%9, Ya),"** be the given points, then 


y, —1 
[x),2,J=2 Yo 
xy — Xo 
Also Ay = 4 =y, 
Ifx,, x,,%,,-++ are equispaced, then x, —x, =h, so that 
= Ayo 
[Xo, x1] = i 
A 
Similarly — [x,,x,]= ae 
Now  [xo,t, ng] = etal 0-1] 
Xo = Xo 
_ Ay, /h— Ayo /h [-- ore =2h] 
oh 
_ Ay — Ayo 
2h? 
A? Yo 
Thus [tei sXol = 


Qh? 
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, Ay 
Similarly [x9,x,,x5]= whe 
Ay, /2h° - A2 yo /2h” A*y, ~ A’ yo 
= [oes tastal= Se, = 2h? (3) E X37 XQ = 3h | 
A®y 
Thus [sas Xas%y |= TG 
_ A" yo 


In general, [x9,x,,---x,]= is 
nth 


This is the relation between divided and forward differences. 


EXAMPLE 7.23 
Given the values 
x: 5 7 11 13 17 
f(x): 150 392 1452 2366 5202 
evaluate f(9), using Newton’s divided difference formula 
Solution: 
The divided differences table is 
x y Ay A’y A’y 
5 150 392 —150 =191 
7-5 
7 392 = 
265 — 121 ~94 
11-5 
1452 — 392 32 —24 
—— = 265 =, 
11-7 13-5 
11 1452 57 
457 — 265 — 39 
13-7 
2366 — 1452 42 — 32 
—— = 457 =] 
13-11 17-7 
13 2366 79 — 
709 — 457 ~ 49 
17-11 
5202 — 2366 
——=709 
17-13 
ry 5202 
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Taking x = 9 in the Newton’s divided difference formula, we obtain 
f(9) = 150 + (9-5) x 121+ (9-5)(9-7) x 24+ (9-5)(9-7)(9-11) x 1 
= 150 + 484 + 192 -16=810. 


EXAMPLE 7.24 


Using Newton’s divided differences formula, evaluate f(8) and f(15) 
given: 


x: 4 5 7 10 11 13 
y = f(x): 48 100 294 900 1210 | 2028 
Solution: 


The divided differences table is 


x Ax) Ay A’y A*y A*y 
4 48 0 
52 
5 100 15 
97 1 
a 294 21 0 
202 1 
10 900 27 0 
310 1 
ul 1210 33 
409 
13 2028 


Taking x = 8 in the Newton’s divided difference formula, we obtain 
f(8) = 48 + (8 — 4) 52 + (8 — 4) (8-5) 15 + (8 — 4) (8-5) (8-7) 1 

= 448. 
Similarly f(15) = 3150. 


EXAMPLE 7.25 


Determine f(x) as a polynomial in x for the following data: 


x: —4 -l 0 2 5 
y =f(x): 1245 33 5 9 1335 
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Solution: 


The divided differences table is 


x Ax) Ay A’y A’y At’y 
—4 1245 
— 404 
= 33 94 
— 28 14 
0 5 10 3 
2 13 
2 9 88 
442 
5 1335 


Applying Newton’s divided difference formula 
f(x) = f(xo) +(x - Xp) [9,41] +(x — x9 (x — x1 )LX9,%1,%_] ++ 
= 1245 + (x + 4) (— 404) + (x + 4) (x + 1) (94) 
+ (x + 4)(x + 1)(x — 0)(— 14) + (x + 4)(x + L)x(x — 2)(3) 


= 3xt — 5x? + 6x? - 14x +5 
EXAMPLE 7.26 


Using Newton’s divided difference formula, find the missing value 
from the table: 


x: i 2 4 5 6 
y: | 14 15 5 7 9 


Solution: 


The divided difference table is 


5-15 _ 7/4+2_3 
43 6-1 4 
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cc y Ay A’y A’y 
4 5 24+5 7 
6-2 4 
9-6, 
6-4 
6 9 


Newton’s divided difference formula is 


Y= Yo 


+ 
= 144 


+(x — Xo )[%9,%,] +(x — xX )(x — x1) [x 9,21, 5 | 


X—Xy M(x — x, x — Xg )[X9,%1,X9.X3]4+°- 


fo = dl) Oar 1) te 2) t= 2) + (¢=1) (e-2) (@-4)5 


Putting x = 5, we get 


y(5) 


= 1444+ (4) (3) (2) + (4) (3) (1) : 


° =3, 
4 


Hence missing value is 3 


Exercises 7.4 


1. Find the third divided difference with arguments 2, 4, 9, 10 of the func- 


tion f (x) =x*- 2x. 
2. Obtain the Newton ’s divided difference interpolating polynomial and 
hence find f(6) 
x: 3 7 9 10 
f@: | 160 | 120] 72 63 
3. Using Newton’s divided differences interpolation, find u(3), given that 
u(1) =— 26, u(2) = 12, u(4) = 256, u(6) = 844. 
4. A thermocouple gives the following output for rise in temperature 
Tem p (°C) 0 10 20 30 40 50 
Output (m V) 0.0 0.4 0.8 1.2 1.6 2.0 


Find the output of thermocouple for 37°C temperature using Newton’s 
divided difference formula. 


. Using Newtons divided difference interpolation, find the polynomial of 
the given data: 
x: -—1 0 1 3 
fi: | 2 1 0 “4 
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6. For the following table, find f(x) a s a polynomial in x using Newton’s 
divided difference formula: 
X: 5 6 9 uw 
f (x): f2, 13 14 16 


7. Using the following data, find f(x) as a polynomial in x: 
x: -1 0 3 6 7 
f(x): 3 -6 39 822 | 1611 


8. The observed values of a function are respectively 168, 120, 72, and 63 
at the four positions 3, 7, 9, and 10 of the independent variable. What is 
the best estimate value of the function at the position 6? 


9. Find the equation of the cubic curve which passes through the point s 
(4, — 43), (7, 83), (9, 327), and (12, 1053). 


10. Find the missing term in the following table using Newton’s divided dif- 
ference formula. 

x: 0 1 2, 3 4 

y: 1 3 9 a 81 


7.16 Hermite’s Interpolation Formula 


This formula is similar to the Lagrange’s interpolation formula. In La- 
grange’s method, the interpolating polynomial P(x) agrees with y(x) at the 
points x,, X,,.....,X,, Whereas in 

Hermite’s method P(x) and y(x) as well as P’(x) and y’(x) coincide at the 
(n + 1) points, i.e., 


P(x,) = y(x,) and P’(x,) =y’(x,); i =0, 1,......, 0 (1) 


As there are 2(n + 1) conditions in (1), (2n + 2) coefficients are to be 
determined. 


Therefore P(x) is a polynomial of degree (2n + 1). 
We assume that P(x) is expressible in the form 


y= Su, (x) y(x, + Ducowts) (2) 


i=0 
where U, (x) and V, (x) are polynomials in x of degree (2n + 1). These are to 
be déennined, Using the conditions (1), we get 
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0 when i # j; V,(x;)=0 for all i 
U(x )J= pele ; 
J 1 when i= j 
ee aaeecieee 7 0 when i j; 
iC ))= paces. ij) = 1 when i= j 
We now write 


U,(2)=4,@) [EP V,@)=8,@0L.@P 
a= (2= m5 eG) = Go ta) m) 
where OG a), Ha) = Senn) hy) 


Since [L,(x)]? is of degree 2n and U(x), V,(x) are of degree (2n + 1), 
therefore A,(x) and Bi(x) are both linear functions 


.. We can write U(x) = (a, + bx) (L(x)? (4) 
and V(x) = (c,+dx)IL, (x)? 
Using conditions (3) in (4), we geta,+bx=1,c, +dx=0 
(5) 
and b+ 2L/(x,)=0,d,=1 
Solving these equations, we obtain 
b, =— 2L;(x;),a; = 1+ 2x,L;(x;) (6) 
d,=1andc,=—x, 


Now putting the above values in (4), we get 
U(x) =[1 + 2x,L;(x,)— 2a; (x; VIL, (0) P 
= [1 - (x — x, Lj (x, IL, (x) P 
and V, (x) = (x —x,) [L,(x)]? 


Finally substituting U,(x) and V,(x) in (2), we obtain 


n 


p(x) = Ss [1-2(x— x, )Lalx ;) Li) ua+ Di x — x, )[Li(x )Py'(x, (7) 


i=0 


This is the required Hermite’s vee formula which is some- 
times known as osculating interpolation formula. 


NOTE Obs. In comparison to Lagrange’s interpolation formula, the 
Hermite interpolation formula is computationally uneconomical 
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EXAMPLE 7.27 


For the following data: 


x: Ix) f(x) 
0.5 4 —16 
1 1 —2 
Find the Hermite interpolating polynomial. 
Solution: 
We have x, = 0.5, x, = 1, y(x,) = 4, y(x,) = 1; y’(x,) =— 16, y(x,) =- 2 
xX—-X x ; 
Also baad Fad ay 1); L;(xo) =—2 
L(y) = E70) = 298 9 rn) 22 


Hermite’s interpolation formula in this case, is 
P(x) =[L—2(x — x )L'(q Ly) Pylxy) + (x = x Ey) P yp) 


{1 — Q(x — x JE", ILL (Pylon ) + Oe — 2 LC, Py") 
=[1-8(=05)(2 


2(x-1)P (4) +(x-0.5)[-2(x-1)P (-16) 


+[1 — 2(x — 1)(2)](2x — 1)?(1) + (x — 1) (2x - 1)?(-2) 
= 161 + 4(x—0.5](x® — 2x +1) —164(x-0.5)(x? - 2x +1) 
+(1 —4(x —1)](4x? — 4x +1) —2(x-1)(4x7 — 4x +1) 


Hence P(x) = —24x? + 324x” — 130x + 23 


EXAMPLE 7.28 


Apply Hermite’s formula to interpolate for sin (1.05) from the following 
data: 


x sin x cos x 
1.00 0.84147 0.54030 
1.10 0.89121 0.45360 
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Solution: 

Here y(x) = sin x and y’(x) = cos x 

so that y(x,) = 0.84147, y’(x,) = 0.54030, y(x,) = 0.89121, 
y’(x,) = 0.45360 


Also Ly(ty)= an 11-10x,Li(x,)=—10 
i 0 

L,(x,)= = ¥0) _ 194 105,1i(s,)=10 
= x) 


Hence the Hermite’s interpolation formula in this case is 
P(x) = [1 — Q(x = x9 )L'(xp )I[L(xq )P y(xq) + (x = 9 L(x) PP yo) 
$[1 = 2(x — 94 Ea ILL (21) Pylon, ) + (= x LLC) Py) 


=[1 — 2(x —1)(-10)](11 — 10x)” (0.84147) + (x —1)(-11 + 10x)? (0.54030) 
+{1 — 2(x —1.1)(10)](-10 + 10x) (0.89121) 
+(x —1.1)(-10 +10x) (0.4536) 
Putting x = 1.05 in P(x), we get 
sin(1.05) = 1 — 2(0.05)(-10)[-10(1.05) +11}°(0.84147) 
+(0.05) (0.5)? (0.54030) + [1 — 2(0.05)(10)](0.5)” x (0.89121) 
+(-0.05)(0.5)° (0.4536) = 0.86742 


EXAMPLE 7.29 


Determine the Hermite polynomial of degree 4 which fits the following 
data: 


x: 0 1 2 
y(x): 0 1 0 
y’ (x): (0) 0 0 
Solution: 


a X es x, =1,x, = 2, y(x,) = 0, y@,) = 1, y(x,) = 0 and y’(x,) = 0, 
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Hermite’s formula in this case is 
P(x) = [1 - 214 (x9 )(x — xq )I[Lg (x) P y(x) + (x — Xp Ly (x)P y'(xo) 
+1 — 2} (x ar — xy) [LU (x) PX yxy) + (x — x, [LU x) Py'(x,) 
+[1 — 215 (xq )(x — x9)] X [Lo (x) P y(xy) + (x — X9)[Lo(x)P y'(xa) 
Substituting the above values in P(x), we get 
P(x) =[1 — 21} (x,)(x- 1) ]LL,(x)P 


Where L,(x)= ae a). =2x—x° and L,'(x,)=(2—-2x),_, = 
X — Xp )(xy— Xp : 
Hence p(x) =[L,(x)F =(@x-x"). 


EXAMPLE 7.30 


Using Hermite’s intropolation, find the value of f(- 0.5) from the fol- 
lowing 


ey -l 0 
fx): di 1 
f(x): =D 1 


Solution: 


Here x, =- 1, x, =0,x, = 1; f(x,) = L.flx,) = 1 flx,) =3 andf(x,) =-5, 
f(x) =Lf(«,) =7 


Hermite’s formula in this case is 


~1] Oo [rR 


(x)= Uo f (xo) + Vof' (xo) +U, f (x4) + Vi f(xy) + Ug f (xg) + Vo f' (xg) (i) 
where U, =[1- 20) (xy)(x—xp) IL), Vo = — xp [Eg (x) F 
U, =[1 — 20} (x,)(x—x IL, (ao) P,V, = (x — x, IE, (x) P 


U, = [1 = 215 (x5)(x = 5) Piel Xe PV. =(x = ta keg (x)P 
52, Roe) ea ese 
and L( a TN 5 ,Lo(x) =x 5 
L(x) = See) 2 x? =Li(x) =—2x 


(%, — Xp), —X,) 


ga MeHg a) 2 pe as 
a 3 =Ly(y)=a+5 
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Substituting the values of Lo,Lo;L,,L; and Ly,L5, we get 


x? (x—1) 

U, =[1+3(x+ 1] ———— 7 
2 2 

x(x - 1 1 ‘ 

Vy =(x 41) Te at (Pox! +2) 


U, =x*- 20° + 1,V l=x°- 23 +x 


=2 (3x5 — 2x4 —5x° +42”) 


Us, =2 (3x° — 2x4 — 5x" +4x*) Vo =2 (x° -x4-x° +x°) 
Substituting the values of U, Vig Ue Vs Ue Ven (i), we get 
P(x) == (3x° — 9x4 — 5x3 +40°)(42 (x° —x* —x3 +x*) 
(x4 — 2x7 +1)(1) +(x? — 2x3 +.x)(1) 
-7x° — 2x4 — 5x3 + 4x?)(3) + ca —xt =x? +x7)(7) 
=2x4 x? +x41 
Hence _f(-0.5) = 2(-0.5)* — (0.5)? + (0.5) +1 = 0.375 


Exercises 7.5 


1. Find the Hermite’s polynomial which fits the following data: 


Xi 0 1 2, 
f(x): 1 3 21 
f(x): 0 3 36 


2. A switching path between parallel rail road tracks is to be a cubic poly- 
nomial joining positions (0, 0) and (4, 2) and tangents to the lines y = 0 
and y = 2. Using Hermite’s method, find the polynomial, given: 


x y y 
0 0 0 
4 2 0 
3. Apply Herm it e’s formula estimate the values of log 3.2 from the follow- 
ing data: 
x y=logx | y’=1/x 
3.0 1.0986 0.3333 
3.5 1.2528 0.2857 
4.0 1.3863 0.2500 
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7.17 Spline Interpolation 


In the interpolation methods so far explained, a single polynomial has 
been fitted to the tabulated points. If the given set of points belong to the 
polynomial, then this method works well, otherwise the results are rough 
approximations only. If we draw lines through every two closest points, the 
resulting graph will not be smooth. Similarly we may draw a quadratic curve 
through points A,, A, , and another quadratic curve through A,_,, A ,,,, such 
that the slopes of the two quadratic curves match at A ,,, (Fig. 7.1). The 
resulting curve looks better but is not quite smooth. We can ensure this 
by drawing a cubic curve through A ,, A,,, and another cubic through A ,_,, 
A ,,,su ch that the slopes and curvatures of the two curves match at A , ,. 
Such a curve is called a cubic spline. We may use polynomials of higher 
order but the resulting graph is not better. As such, cubic splines are com- 
monly used. This technique of “spline-fitting” is of recent origin and has 
important applications. 


FIGURE 7.1 


Cubic spline 
Consider the problem of interpolating between the data points (x,, y,), 
(x,, Y,),-+-(x,, y,,) by means of spline fitting. 


Then the cubic spline f(x) is such that 

(i) f(x) is a linear polynomial outside the interval (x,, x,), 
(ii) f(x) is a cubic polynomial in each of the subintervals, 
(iii) f(x) and f’(x) are continuous at each point. 


Since f(x) is cubic in each of the subintervals f’(x) shall be linear. 
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. Taking equally-spaced values of x so that x,,— x, =h, we can write 


FO = FL —a) Fe) +a) fa] 


Integrating twice, we have 


(x — x,) 


F=T a Pte 


The constants of integration a, b, are determined by substituting the 
values of y =f(x) at x, and x,,,. Thus, 


Ps) cae x) +b,(x-x;) (1) 


1 a 1 a 
qd; =H ~3r a) and b, = if =a in) 
Substituting the values of ai, bi and writing /’(x,) = M, (1) takes the form 


f(x)= (Xj x)" +2 Mons 


6h 6h 
Xj41 —X he XX; he 
arma E44 Pate (2) 


ni 


2 2 
Xia —X) x— x; 1 
os po=—! = a+! Min ~% Myx —Mi)+7-(yin — 9) 


2h 6h 


To impose the condition of continuity of f (x), we get 
f(x-)=f(xte)ase 70 


h 1 h 1 
a gem $M.) +7 (yi —Y44) = ~ gem + Min) +7 Viet — yj) 


6 
M,1+4M;, + Misi = 75 Yea ~ 24 + Yin) t= 1 ton-1 (3) 


Now since the graph is linear for x < x, and x > x,, we have 
M,=0,M, =0 (4) 
(3) and (4) give (n + 1) equations in (n + 1) unknowns M, (i = 0, 1,--- n) 


which can be solved. Substituting the value of M, in (2) gives the concerned 
cubic spline. 
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EXAMPLE 7.31 


Obtain the cubic spline for the following data 


Solution: 
Since the points are equispaced with h = 1 and n = 3, the cubic spline 
can be determined from M, ,+4M,+M,,,=6 (y,,-2y,+y,,,), i= 1, 2. 
M,+4M,+M,=6 (y,- 2y,+ y,) 
M,+4M,+M,=6 (y, - 2y, + y,) 
ie,  4M,+M,=36;M, +4M,=72 [:.- M,=0, M, =0] 
Solving these, we get M, = 4.8, M, = 16.8. 


Now the cubic spline in (x, <x <x, + 1) is 
1 1 1 
I(x) = ein x)" M; +2(2-4)° May + (241 -afo =a 
1 
+(x—x;) Yitl Guin 


Taking i = 0 in (A) the cubic spline in (0 <x < 1) is 
flx)= 51-2990) +2 -0(48) +0 x)(x—0) +x[-6 (48) 


= 0.8x° — 8.8x + 2 (0<x<1) 
Taking i = 1 in (A), the cubic spline in (1 <x < 2) is 


F()= 22 39'(48)+ 20-1068) +2 6-=(48)] 
+(x—D[- 8-1(16.8)] 
= 2x3 — 5.84x2 — 1.68x + 0.8 
Taking i = 2 in (A), the cubic spline in (2 <x < 3) is 


flx)==6 -1)°(4.8)+=(r-2)°0) +B —VL- 8 —1(16.8)] 


+(x — 2)[2—1(2)] 
= — 0.8x? + 2.64x? + 9.68x — 14.8 
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EXAMPLE 7.32 


The following values of x and y are given: 


x: 1 2 3 + 
1 2 5] 11 


Find the cubic splines and evaluate y(1.5) and y’(3). 


Solution: 


Since the points are equispaced with h = 1 and n = 3, the cubic splines 
can be obtained from 


M,_,+4M,+M,,,=6(y,,-2y,+y,,, 

M,+ 4M, + M, = 6(y, -— 2y, + y,) 

M, +4M, + M,=6ly, — 2y, + y,) 

ie., 4M,+M,=12,M,+4M,=18 [+s M,=0,M,=0] 
which give, M, =2, M, =4. 


Now the cubic spline in (x, <x <x,_,) is 


F() =F (ri =X) Mp $C a) Misi +(x sa). | 


)i=1, 2. 


1 
He—m)( yen = 2M] (A) 
Thus, taking i = 0, i = 1, i = 2 in (A), the cubic splines are 
g P 

: =(x3 —3x? +5x)1< Sx2 

3 

N= fo(0°-32 +5x)2 <x<3 

s(- 2x° 24x? —76x +81)3Sx <4 


y(1.5) = f(1.5) = 11/8 


EXAMPLE 7.33 
Find the cubic spline interpolation for the data: 


x: 1 2 3 4 5 
f (x): 1 0 1 0 1 
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Solution: 


Since the points are equispaced with h = 1, n = 4, the cubic spline can 
be found by means of 


M,_, + 4M, +M,4, = 6(y_, —2y; + yi41),4= 12,3 
M, + 4M, +M, =6(yo —2y, +.) =12 
M, + 4M, +M, =6(y, —2y, + y3)=—12 
M, +4M, +M, =6(y2 —2y3 + y4) =12 
Since My) =y")=0 and M,=y",=0 


4M, + M, =12;M, +4M, +M, =-12;M, + 4M, =12 
Solving these equations, we get M, = 30/7, M, = — 36/7, M, = 30/7 


Now the cubic spline in (xi <x < xi+1) is 


1 1 
f(x) = gt =x) M, +o (x—, y Min +(x: —x) 


Taking i = 0, in (A), the cubic spline in (1 <x < 2) is 
_ \3 3 1 
y= slim =a) My + (e=2)) M, ]+(x, =1)(vo - 2m | 


1 
He-m)[a -ém} 


= Ale —x)°(0)+(x-29)° (30/7) ]+(2- ot - 5 (0)| 


1/30 
Ho=Dl0—2| = 
. \ ste] 
i.eé., y = 0.71x3 — 2.140? + 0.42x+2 (1 <x <2) 


Taking i = 1 in (A), the cubic spline in (2 <x < 3) is 
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i.e€., y =- 1.5743 + 11.57x? - 27x + 20.28. (2<x <3) 
Taking i = 2 in (A), the cubic spline in (3 <x < 4) is 


yaheao'(-} hese H4-9[t-H{ 9} oa (0-3) 


i.@., y = 1.57 x3 — 16.71 x? + 57.86x — 64.57 (3 <x< 4) 
Taking i = 3 in (A), the cubic spline in (4 <x <5) is 


=1a-x)° & ?|+(5=2) (-2}+@-900 


i.e., y = —0.71x° + 2.14x? — 0.43x — 6.86. (4<x<5) 


Exercises 7.6 


1. Find the cubic splines for the following table of values: 
x 1 2 3 
y | -6 | -1 | 16 
Hence evaluate y(1.5) and y’(2). 


2. The following values of x and y are given: 


x 1 2 3 4 
y: 1 5 u 8 
Usin g cubic spline, show that 
(i) y(1.5) = 2.575 (ii) y’(3) = 2.067. 
3. Find the cubic spline corresponding to the interval [2,3] from the 
following table: 
x 1 2 3 4 5 
y: 30 15 32 18 25 


Hence compute (7) (2.5) and (ii) y’(3). 


7.18 Double Interpolation 


So far, we have derived interpolation formulae to approximate a func- 
tion of a single variable. In the case of functions, of two variables, we inter- 
polate with respect to the first variable keeping the other variable constant. 
Then interpolate with respect to the second variable. 
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Similarly, we can extend the said procedure for functions of three vari- 


ables. 


7.19 Inverse Interpolation 


So far, given a set of values of x and y, we have been finding the value 
of y corresponding to a certain value of x. On the other hand, the process 
of estimating the value of x for a value of y (which is not in the table) is 
called inverse interpolation. When the values of x are unequally spaced La- 
grange’s method is used and when the values of x are equally spaced, the 
Iterative method should be employed. 


7.20 Lagrange’s Method 


This procedure is similar to Lagrange’s interpolation formula (p. 207), 
the only difference being that x is assumed to be expressible as a polynomial 
in y. 

Lagrange’s formula is merely a relation between two variables either of 
which may be taken as the independent variable. Therefore, on interchang- 
ing x and y in the Lagrange’s formula, we obtain 


fe, PIN a ORD) yo WII al yn) 


(y=) V—-In) 2 AA VIO A=I2) "= Iy) | 
4 (V-YI)Y-Y)V-Yr-a) 
(Yo =Vo¥n — PIO —F,-4) 


EXAMPLE 7.34 


The following table gives the values of x and y: 


x: 1.2 2.1 2.8 4] 49 6.2 

y: 42 6.8 9.8 13.4 15.5 19.6 

Find the value of x corresponding to y = 12, using Lagrange’s tech- 
nique. 

Solution: 


Here x, = 1.2, x, = 2.1, x, = 2.8, 1, =4.1,x,=4.9, x, = 6.2 and y, = 4.2, 
y, = 6.8, y, = 9.8, y, = 13.4, y, = 15.5, y, = 19.6. 
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Taking y = 12, the above formula (1) gives 


(12 — 6.8)(12 —9.8)(12 -13.4)(12 - 15.5)(12 - 19.6) 

(4.2 —6.8)(4.2 -9.8)(4.2 —13.4)(4.2 -15.5)(4.2-19.6) 
(12 — 4.2)(12 —9.8)(12 -13.4)(12 -15.5)(12 -19.6) 
(6.8—4.2)(6.8 —9.8)(6.8 — 13.4)(6.8 — 15.5)(6.8 — 19.6) 
(12 — 4.2)(12 — 6.8)(12 — 13.4)(12 -15.5)(12 -19.6) 

(9.8 — 4.2)(9.8 — 6.8)(9.8 —13.4)(9.8 —15.5\(9.8 — 19.6) 
(12 —4.2)(12 — 6.8)(12 — 9.8)(12 -15.5)(12 -19.6) 
(13.4 — 4.2)(13.4 — 6.8)(13.4 — 9.8)(13.4 -15.5)(13.4—19.6) 
(12 — 4.2)(12 — 6.8)(12 — 9.8)(12 -13.4)(12 - 19.6) 
(15.5 —4.2)(15.5 —6.8)(15.5 — 9.8)(15.5—13.4)(15.5 19.6) 
(12 —4.2)(12 — 6.8)(12 — 9.8)(12 -13.4)(12 - 15.5) 
(19.6 — 4.2)(19.6 — 6.8)(19.6 — 9.8)(19.6 — 13.4)(19.6 —15.5) 


= 0.022 — 0.234 + 1.252 + 3.419 — 0.964 + 0.055 = 3.55 


EXAMPLE 7.35 
Apply Lagrange’s formula inversely to obtain a root of the equation 
fix) =0, given that f(30) = — 30, f(34) =— 13, f(38) = 3, and f’(42) = 18. 
Solution: 
Herex, = 30, x= 34, x= 38, x= 42, 
and y, =— 30, y, =— 13, y,=3, y, = 18 
It is required to find x corresponding to y = f(x) = 
Taking y = 0, Lagrange’s formula gives 
__ Y= ny yoly=¥s)_ (Y= Yolly = Yo ly = Ys) 
(Yo — Y1)(Yo = Yo)(Yo = Ys) : (41 — Yor = Yo).(t (yl— ys) , 
a (y= Yoly - iti Ys) ; (y= Yo)ly — Wy = Ya) 
Xg + X3 
(Yo — Yo)(Y2 — Yi )(Ya — Ys) (Ys — Yo)(Ys — Yi )(Ys — Yo) 


13(—3)(-18) 30(—3)(—18) 
= Ci7)(33)(—48) 1716) (3 * 

30(13)(—18) 30(13)(—3) 

33(16)(—15) 48(31)(15) 


= — 0.782 + 6.532 + 33.682 — 2.202 = 37.23. 
Hence the desired root of f(x) = 0 is 37.23. 
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7.21 Iterative Method 


Newton’s forward interpolation formula (p. 274) is 


pp —1)(p—-2) 


31 Mey +... 


Yo t+ 


-—] P 
Yp = Yo + pAyo + ee a? 


From this, we get 

1 
he) 1 

on (1) 


Neglecting the second and higher differences, we obtain the first ap- 
proximation to p as 


-] -1)\(p-2 
Pp. Vary, + PP we aby 


[y.-90+ 


P= (y, - yo) /AYo (2) 
To find the second approximation, retaining the term with second dif- 
ferences in (1) and replacing p by p,, we get 


(3) 


To find the third approximation, retaining the term with third differ- 
ences in (1) and replacing every p by p,, we have 


J a\po-1).. o(ps—1)\ps-§ 
pom nse se ) ay, 4 2s thes Lay 


and so on. This process is continued till two successive approximations of p 
agree with each other 


NOTE Obs. This technique can be equally well be applied by starting 
with any other interpolation formula. 


This method is a powerful iterative procedure for finding the 
roots of an equation to a good degree of accuracy. 


EXAMPLE 7.36 


The following values of y = f(x) are given 


x: 10 15 20 
y: 1754 | 2648 | 3564 
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Find the value of x for y = 3000 by iterative method. 


Solution: 
Taking x, = 10 and h =5, the difference table is 
i y Ay A’y 
10 1754 
894 
15 2648 22 
916 
20 3564 


Here y= 3000, y, = 1754, Ay, = 894 and A?y0 = 22. 
The successive approximations to p are 


1 
(3000 — 1754) =1.39 


Pi = 304 
1890.9“) x90] =1.387 


4 


i 
=| 3000 =1754= 
Pe al 


1 1.387(1.387 — 1 
P3 = =i] 2000 _ 17D x 22 = 1.3871 
“894 : 
We, therefore, take p = 1.387 correct to three decimal places. Hence 
the value of x (corresponding to y = 3000) = x, + ph = 10 + 1.387 x 5 = 
16.935. 


EXAMPLE 7.37 
Using inverse interpolation, find the real root of the equation x3 + x — 


3= 0, which is close to 1.2. 


Solution: 
The difference table is 
eG y Verte =o Ay A’y A’y Aty 
1 — 0.2 -l 0.431 

0.066 
1.1 | -0.1 — 0.569 0.497 0.006 

0.072 0 
ie: 0) — 0.072 0.006 
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a y Y=xe+x-3 Aty 
1.3 0.1 0.497 
1.4 0.2 1.144 


Clearly the root of the given equation lies between 1.2 and 1.3. Assum- 
ing the origin at x = 1.2 and using Stirling’s formula 


Ay, +A Pe ne 
Yo slr A’y_, + 
2 2 


0. i x(x 
pass 569 “ 0.467 re = (0.072) + x(x 


x(x” — 1) . A®y_, +A°y_» 
6 2 


PT) (28 sue 
6 2 


Y=Yo rx , we get 


(- y=0) 
or 0 =-0.072 + 0.532x + 0.036x" + 0.001x° (i) 
This equation can be written a s 


0.072 0.036 , 0.001 5 
C= = x x 
0.532 0.532 0.532 


 _ 0.072 
0.532 


Putting x =x" on R.HLS. of (i), we get 


‘. First approximation x = 0.1353 


Second approximation 
x?) = 0.1353 — 0.067(0.1353)? — 1.8797(0.1353)? = 0.134 
Hence the desired root = 1.2 + 0.1 x 0.134 = 1.2134. 


Exercises 7.7 


1. Apply Lagrange’s method to find the value of x when f(x)=5 from the 
given data: 
x: 5 6 9 11 
fix): | 12 13 14 16 
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2. Obtain the value of t when A = 85 from the following table, using La- 
grange’s method: 

t: 2, 5 8 14 

A: 94.8 87.9 81.3 68.7 


3. Apply Lagrange’s formula inversely to obtain the root of the equation 
fix) =0, given that (30) =— 30, f(34) =— 13, f(38) =3 and f(42) = 


4. From the following data: 


Xx: 1.8 2.0 2.2 2.4 2.6 


y: 2.9 3.6 4.4 5.5 6.7, 
find x when y = 5 u sin g the iterative method. 


5. The equation x° — 15x + 4=0 ha s a root close to 0.3. Obtain this root 
upto four decimal places using inverse interpolation. 
6. Solve the equation x = 10 log x, by iterative method given that 


x: | 1.35 1.36 1.37 1.38 
log x: | 0.1303 | 0.1355 | 0.1367 | 0.1392 


7.22 Objective Type of Questions 


Exercises 7.8 


1. Select the correct answer or fill up the blanks in the following question: 
Newton’s back war d interpolation formula is......... 


2. Bessel’s formula is most appropriate when p lies between 
(a) -—0.25 and 0.25 = (b) 0.25 and 0.75 (c) 0.75 an d 1.00 


3. Form the divided difference table for the following data: 


5. Bessel’s formula for interpolation is...... 


6. The four divided differences for x), x,,%,, 5) X4 =. 
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7. Stirling’s formula is best suited for p lying between...... 


12. 


13. 
14. 
15. 


16. 


17. 


18. 


19. 


. Newton’s divided differences formula is....... 

. Given (x,, y,), (x, y,), (x,, y,), Lagrange’s interpolation formula is....... 
. If f(0) = 1, (2) =5, (3) = 10 and fix) = 14, then x =...... 

. The difference between Lagrange’s interpolating polynomial and 


Hermite’s interpolating polynomial is....... 


If y(1) = 4, y(3) = 12, y(4) = 19 and y(x) =7, find x using Lagrange’s 


formula. 
Extrapolation is defined as....... 
The second divided difference of f (x) = 1/x, with arguments a, b, c is...... 


The Gauss-forward interpolation formula is used to interpolate values of 
y for 


(a)O<p<l (b)-1<1<0 
(c)O<p<-a (d)-a<p<0O 
Given 

ie 0 1 3 4 

y: | -12 | 0 6 12 


Using Lagrange’s formula, a polynomial that can be fitted to the data 


The nth divided difference of a polynomial of degree n is 
(a) zero (b) a constant 
(c) a variable (d) none of these. 


The Gauss forward interpolation formula involves 

(a) differences above the central line and odd differences on the cen- 
tral line 

(b) even differences below the central line and odd differences on the 
central line 

(c) odd differences below the central line and even differences on the 
central line 

(d) odd differences above the central line and even differences on the 
central line. 


Differentiate between interpolation polynomial and least square polyno- 
mial obtained for a set of data. 


CHAPTER 


NUMERICAL DIFFERENTIATION 
AND INTEGRATION 


Chapter Objectives 

e Numerical differentiation 

e Formulae for derivatives 

e Maxima and minima of a tabulated function 
e Numerical integration 

e Quadrature formulae 

e Errors in quadrature formulae 

e Romberg’s method 

e Euler-Maclaurin formula 

e Method of undetermined coefficients 
e Gaussian integration 

e Numerical double integration 


e Objective type of questions 


8.1 Numerical Differentiation 


It is the process of calculating the value of the derivative of a 
function at some assigned value of x from the given set of values 
(x,, y,). To compute dy/dx, we first replace the exact relation y = f(x) 
by the best interpolating polynomial y = @(x) and then differentiate 
the latter as many times as we desire. The choice of the interpola- 
tion formula to be used, will depend on the assigned value of x at 


which dy/dx is desired. 
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If the values of x are equispaced and dy/dx is required near the begin- 
ning of the table, we employ Newton’s forward formula. If it is required 
near the end of the table, we use Newton’s backward formula. For values 
near the middle of the table, dy/dx is calculated by means of Stirling’s or 
Bessel’s formula. If the values of x are not equispaced, we use Lagrange’s 
formula or Newton’s divided difference formula to represent the function. 


Hence corresponding to each of the interpolation formulae, we can de- 
rive a formula for finding the derivative. 


Obs. While using these formulae, it must be observed that the 
table of values defines the function at these points only and 
does not completely define the function and the function may 
not be differentiable at all. As such, the process of numerical 
differentiation should be used only if the tabulated values 

are such that the differences of some order are constants. 
Otherwise, errors are bound to creep in which go on increasing 
as derivatives of higher order are found. This is due to the 

fact that the difference between f(x) and the approximating 
polynomial @(x) may be small at the data points but f (x) — @’(x) 
may be large. 


NOTE 


8.2 Formulae for Derivatives 


Consider the function y = f(x) which is tabulated for the values x,(= x, + 
ih),i=0, 1,2, ...n. 


Derivatives using Newton’s forward difference formula 


Newton’s forward interpolation formula (p. 274) is 


—-l) ., -l)\(p-2 
Y = Yo t pAyy + Be  2y, p Pipa ile 2) ae Ay, +... 
Differentiating both sides w.r.t. p, we have 
dy Q2p-1 , | Sp'—6p+2 
Gp 7B ti A?yy + FE yg +. 
Since p= (x=) 


Therefore dp = i 
dx h 
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dy _ dy dp 2p—1 3p’ —6p+2 ., 
DM Fe aa =t amy ay Yo tay Yo 
4n® —18p* + 22p-6 
eS Ay + (1) 


Atx =x,, p =0. Hence putting p = 0, 


dy\ 1 i oe... 1 1 ioe 
(A). = ae Ayo +A Yo — FA Yo +A’ yo — EA yo +. | (2) 
Again differentiating (1) w.r.t. x, we get 


ay _ d { dy \dp 
dx’ dp\ dp} dx 


1/2 5 , 6p-6 ,  , 12p?-36p -36p +22, 1 
-j|2a' "ee ad 4! a eas 


Putting p = 0, we obtain 


d°y Cae 137 
(4)- he rates AY Yo + aA Yo — a Yo + As Yo + | (3) 


d 
Similarly (<4 i rae =a Yo + a 
Otherwise: We know that 1 + A = E =e"? 


i 4. dena dl 
hD = log(1+ A)= A-—A* +—A® -—A* +. 
2 3 4 


1 oe | 1 
or D= Ja-5ar+ A? = ght | 


3 
and D’= a|4°-3 —A* 4 | 


Now applying the above identities to y,, we get 


dy 1 1}, 1 1 1 lig 
Dy, i.é., (= | = 7 Ayo _ 5) JAY 3 A®yo —7h"y0 + shy -_e Yo +... 
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and 


dy 5 ae 
(<4) aks Yo — A’, Yo +S =a Yo — aL +aty-... 


dt 
(<4)- he rats Yo — Sty +... 


which are the same as (2), (3), and (4), respectively. 


Derivatives using Newton’s backward difference formula 
Newton’s backward interpolation formula (p. 274) is 
+1)_. +1)(p+2 
p(p dey 4, Ppt Vp By, on 
2! 3! 
Differentiating both sides w.r.t. p, we get 


Y= Yn + PpVyn + 


dy 4, Ptles 3p? +6pt+2_. 
dp =Vy,, + 2! Vv Yn 3] Vv Ue 
Since p= a therefore. # ; 
AY 


Now 


dy dy dp 20416 3p? +6p +2 P 
Ny, PA, gh Es, gol) 
dx dp dx ; a 3! as 


Atx =x, p =0. Hence putting p = 0, we get 


dy 1 ls las 14 Lee 1g 
at) ee) Vy dV, + Vg FV Ho FOV y, | 
(4) Al Yn 2 Yn 3 Yn 4 Yn 5 Yn 6 Yn, ( ) 


Again differentiating (5) w.r.t. x, we have 


dy d (<4) dp 


dx” ~ dp dx } dx3 
i er 6p +6 6p? +18p +11 
= ran +t v'y, +p vy, a 


Putting p = 0, we obtain 


d* 1 ll 5 _ 137 
eel Ma trata rn thn ret |] o 
XG 


180 


Similar} ay) als Voy, +2V4 
mar. Yy, dx? ~ h? Yn + ») Yn eee (8) 
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Otherwise: We know that 1 — V = E' =e" 


-hD = log(.-V)=-1V +5" +29" +2! 4 


1 re | 1 
or D= |v+ Ve Vv + v'+..| 
h 2 3 4 


| | Pt Tg ll 
D? = ale Vi + Vi +-| = [VeVi vl + 
h? 2 2 h 12 


Similarly, D =73 a|v +s —Vi+ | 


Applying these identities to y , we get 


_ (dy\ 1 l l in; 
Dy, ie., (4) =F], #50, + oN ont ZV 


i 5 1 6 
Voy, +—Voy, to 
dx . Yn 6 Yn 


5 


d*y 5 17% 
| 4 - A? rahereae ytS 5v Y AZ, Ey, | 


180 
dy 
and (4) - = raha | aon SViy, + | 


which are the same as (6), (7), and (8). 
Derivatives using Stirling’s central difference formula 


Stirling’s formula (p. 289) is 


+t Ayo + Ay_; Ae: ‘A 
Yp = Yo + 5) Pop Y-) 


2 2 3 3 Df. 20} 2 

—17)( A3y_, + A2y_. si 

PP ){A°yy y-o |, P (p ) Mit 
3) 2 4) 


Differentiating both sides w.r.t. p, we get 


dy -(“ + Ay_; J 2p A’y_, + 3p —1/A°y_, + A°y-» 
dp 2 | 3! 2 


4p® —2 
+t aly, + 
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Now ee ae eat pty. seal A*y-, + Ay» 
dx dp dx h 26 6 


Atx =X), 


(=) _ | ety 1 1A’y ,tA®y_s n 1 A’y_, t+A°y_s te (9) 


p = 0. Hence putting p = 0, we get 


dx}, h 2 6 2 30 2 
dy) 1. 1, L ié 
Similarly (4) = rate 1 TL 2 +oy4y 3 ---| (10) 


Derivatives using Bessel’s central difference formula 


Bessel’s formula (p. 290) is 


pip—1) A*y_, +A’y L\ p=) ..; 
Yp = Yo + PAYo ee P-5 ar Ay 


Ap® — 6p? —2n +2 A*y_, +A 
4p — Sp =2pt2 Ary ot Aly | 


4) 2 
Since pao, AP _ : 
h dx h 
_ 47 Ad, 2 
ate dy ty th 3) OPT LA y t Arye 
dx dp dx h 2) 2 
ere 
we Pe as , Sp? = 6p" = 2p +2 Aty 9 +Aty 
3! “ 4) 2 ~ 
Atx =x,, p = 0. Hence putting p = 0, we get 
dy 1 1 A*y_, +A’ Yo 1 43 
—| =—|Ay,- +—A”y ila 
en | 40 Al 2 1 7 as 
44 Aty-. +Aty-1 oe 
12 2 
Similarly 


ay Ay, FA24 Aty_,+A‘*y 
/) = : a --A%y_,- a he) 
dx . h? 2 2 12 2 


Xo 
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Derivatives using unequally spaced values of argument 
(i) Lagranges’s interpolation formula is 
f(x)= (= 2 = ty jee — a, f(x») 


(5 i ty haley =, 


pg) gO a) 
Differentiating both sides w.r.t. x, we get f (x). 
(ii) Newton’s divided difference formula is 
f(x) = f lx) + (x — x9 AF (xq) + (x — 9) (x — 1 A? f (x) 
+(x — x9 (x — x, )(x - a, JA° f(xy) + 
pete ah both sides w.r.t. x, we obtain 
f' (x) = Af (x0) + [2x = (xp +x,)] A? f (x9) + 13x? — 2x(xy +. +x) 
+(xpx, $xyX9 +29%5)] A’ f(xy) + 
EXAMPLE 8.1 
Given that 


Xi 1.0 1.1 1.2 1.3 14 15 1.6 


y: | 7.989 8.403 | 8.781 9.129 9.451 9.750 | 10.031 


find 2 2Y and 2 4 Yat(a)x=1.1 (b)x=16. 


dx dee 
Solution: 
(a) The difference table is: 
x y A A? AS M AS AS 
1.0 7.989 
0.414 
‘Tl 8.403 — 0.036 
0.378 0.006 
1.2 8.781 — 0.030 — 0.002 
0.348 0.004 0.001 
1.3 9.129 — 0.026 — 0.001 0.002 
0.322 0.003 0.003 
1.4 9.451 — 0.023 0.002 
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x y A A? AS At Ae AS 
0.299 0.005 
1.5 9.750 — 0.018 
0.281 
1.6 10.031 
We have 
dy 1 bg 
(4) =+ Ay A'Yo vee Yo tT A Yo +ZA Yo ZA Yo t | i) 
2 
and eal - rabee —A°y a 5) A'Yo -24 Yo +a Yo — (ii) 


Here h = 0.1, x, = 1.1, Ay, = 0.378, A’y, = — 0.03 ete. 


Substituting these values in (i) and (ii), we get 


dx} O.1 


4 


(54) : mo 378 — . (—0.03) + = (0.004) - =(-0.001) + +(0.003) = 3.952 


2 
kh mes |=0.03 — (0,004) ++ (~0.001) — 7.0003) =-3.74 
de} (0.12 12 6 


(b) We use the above difference table and the backward difference op- 
erator V instead of A. 


dy\ 1 Toe, le, lice, 2 dare 
=o Vay toy, FOV y. Hoy, FOV, i 
(2) Al Yn 2 Yn 3 Yn 5 Yn 6 Yn (i) 
qed rahi +V% + avi +2" gaol hy | (ii) 
an Hy 
a dx? ~ 72 Yn Yn Yn Yn 180 y, + Ww 


Here h = 0.1, x, = 1.6, Vy, = 0.281, Vy, =— 0.018 ete. 


Putting these values in (i) and (ii), we get 


dx 


2, 


(#4) - alo. 961 4— = (- 0.018) + 1 0.05) + £(0,002) 
ke ee 5 4 


+=(0.008) + =(0.002)| = 2.75 
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d° 1 ll 5 
J) = —|-o018 +0.005 +—(0.002) + (0.003) 
dx} 1p 12 6 
137 
+= (0.002)| =-0,715. 
180 
EXAMPLE 8.2 


The following data gives the velocity of a particle for twenty seconds 
at an interval of five seconds. Find the initial acceleration using the entire 
data: 


Time t (sec): 0 5 10 15 20 
Velocity v(m/sec): 0 3 14 69 228 
Solution: 


The difference table is: 


i v Av A’? v NGO Atv 
0 0 
3 
5 3 8 

11 36 

10 14 44 24 

55 60 

15 69 104 

159 
20 228 


ve dv ; ; 
An initial acceleration ie, 2] at t = 0 is required, we use Newton’s 
forward formula: 


do 1 1. ire 1 
( | =7 (Aq - 34% $5 — Tain + 
t=0 2 3 4 


dt h 
dv 1 1 1 1 
(= . we [3- i (8)+ F (36) -— 5 24)| 


i 
==(3-4+12-6)=1 


Hence the initial acceleration is 1 m/sec?. 
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EXAMPLE 8.3 
Find the value of cos (1.74) from the following table: 


Xi L.7 1.74 1.78 1.82 1.86 
sin x: 0.9916 | 0.9857 | 0.9781 | 0.9691 | 0.9584 


Solution: 
Let y =f (x) = sin x. so that f(x) = cos x. 
The difference table is 


y Ay A’y A’y Aty 
1.7 0.9916 
— 0.0059 
1.74 0.9857 — 0.0017 
— 0.0076 0.0003 
1.78 0.9781 — 0.0014 — 0.0006 
— 0.0090 — 0.0003 
1.82 0.9691 — 0.0017 
— 0.0107 
1.84 0.9584 
Since we require f’(1.74), we use Newton’s forward formula 
we +| Aw =5 —A*yp a = Ayo == A‘yy + (i) 


Here h = 0.04, x, = L.7, Ay, =— 0.0059, A’y, =— 0.0017 ete. 


oe these values in (i), we 


dx 


4 


(4) = aay] 0. 0059-51 0.0017) + = (0.008) =—(- 0.0006) 
174 (0.04 2 4 


——(0,007) = 0.175 
~ 0.04 


Hence cos (1.74) = 0.175 


EXAMPLE 8.4 


A slider in a machine moves along a fixed straight rod. Its distance x cm. 
along the rod is given below for various values of the time t seconds. Find 
the velocity of the slider and its acceleration when t = 0.3 second. 
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Solution: 


The difference table is: 


I a A Ne Ae At A? A 
0 30.13 
1.49 
0.1 31.62 — 0.24 
1.25 — 0.24 
0.2 32.87 — 0.48 0.26 
0.77 0.02 — 0.27 
0.3 33.64 — 0.46 —0.01 0.29 
0.31 0.01 0.02 
0.4 33.95 — 0.45 0.01 
—0.14 0.02 
0.5 33.81 — 0.43 
— 0.57 
0.6 33.24 


As the derivatives are required near the middle of the table, we use 
Stirling’s formulae: 


(<) =} (A0t ae) fA eAr | pet), (i) 
t, 


dt}, h 2 6 2 30 2 
at) 1 ive 1. ng 
[Ss] =a 1 yg A's 2 +54 | (ii) 


Here h = 0.1, t, = 0.3, Av, = 0.31, Av_, = 0.77, A’x_, =— 0.46 ete. 


> "0 


Putting these values in (i) and (ii), we get 


(<t) | OS1+077 1/0014 002) , | (9002) = 
dx}, 0.1 2 6 2 30 2 _ 


de}. (1 12 90 
Hence the required velocity is 5.33 cm/sec and acceleration is 
— 45.6 cm/sec”. 


2, 
(o ss |-0.46-Z (000) + (029)---]= 456 
0.3 
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EXAMPLE 8.5 
The elevation above a datum line of seven points of a road are given 
below: 
x: 0 300 600 900 1200 1500 1800 
Y: 135 149 157 183 201 205 193 


Find the gradient of the road at the middle point. 
Solution: 

Here h = 300, x, = 0, y, = 135, we require the gradient dy/dx at x = 900. 
The difference table is 


a y Ay My A®’y A‘y A’y 
0 135 
14 
300 149 -6 
8 24 
600 157 18 —50 
26 — 26 70 
900 183 -8 20 
18 -6 -16 
1200 201 -14 4 
4 -2 
1500 205 —16 
-12 
1800 193 


Using Stirling’s formula for the first derivative [(9) p. 000], we get 


ui) = 21 ( Avot Aven) 1 Aby-1 + A°y-s), 1 (Ayo tA°y-s 
Pe, 26 6 2 30 2 


1fl i i 
= aal3 8 +26) -—(-6 — 26) +—(-16+ 70) 
300.2 12 60 
1 
= —— (22 + 2.666 + 0.9) = 0.085 
300 


Hence the gradient of the road at the middle point is 0.085. 
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EXAMPLE 8.6 
Using Bessel’s formula, find f’(7.5) from the following table: 


x: 7.47 7.48 7.49 7.50 Tol 7.52 7.53 
f(x): 0.193 0.195 0.198 0.201 0.203 0.206 0.208 
Solution: 
Taking x, = 7.50, h = 0.1, we have p= ‘ 5 sae —7.50 
0.01 
The difference table is ‘ 
x p Y, A A? IX? (Ne A’ A° 
TA7 —3 0.193 
0.002 
7.48 = 2, 0.195 0.001 
0.003 — 0.001 
7.49 —l 0.198 0.000 0.000 
0.003 — 0.001 0.003 
7.50 0) 0.201 — 0.001 0.003 — 0.01 
0.002 0.002 — 0.007 
toll 1 0.203 0.001 — 0.004 
0.003 — 0.002 
7.52 2 0.206 — 0.001 
0.002 
7.53 3 0.208 
Using Bessel’s formula for the first derivative [(11) p. 000], we get 


dy\ _1 ov ; ee 1 
cal SG UeF CER RERE CRD 


1 5 1 6 6 
pap Yagi #8] 
dy 1 1 1 1 
WY) = =i | 0.02 ——(—0.001 + 0.001) + —(0.002) + — (—0.004 + 0.003) 
dx},, 0.01 4 12 24 
i 
———(-0.007)— —~(—0.010 +0 
120" ) 
[= NG. = 0] 


=0.2 + 0 + 0.01666 — 0.0416 + 0.00583 + 0.00416 = 0.223. 
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EXAMPLE 8.7 
Find f’(10) from the following data: 


x: 3 5 11 27 34 
fix): -13 23 899 | 17315 | 35606 


Solution: 


As the values of x are not equispaced, we shall use Newton’s divided 


difference formula. The divided difference table is 


x fix) Ist div 2nd div. 3rd div. Ath div. 
diff. diff. diff. diff. 
3 -13 
18 
D 23 16 
146 0.998 
al 899 39.96 0.0002 
1025 1.003 
27 17315 69.04 
2613 
34 35606 


Fifth differences being zero, Newton’s divided difference formula for 


the first derivative (p. 274), we get 


| AC ae one 


fo 


Putting X= 


f'O)= 


Xq> X,) + (2x —x,- 


ied Cae 


Ci oe.) 


PSOE bh ih, Pe ae ee) | eK ae) 


+ [Age 30 ex x) Ole 


ott 


+ XX, +X 


a eae 


I fltg, X15 Xa, Xp X4) 


3,%,=5,x,= 11, x,= 27 and x = 10, we obtain 
18+ 12 x 164+ 23 x 0.998 — 426 x 0.0002 = 232.869. 


8.3. Maxima and Minima of a Tabulated Function 


Newton’s forward interpolation formula is 


y= 


Yo + pAyy + 


pp 1) 
2) 


Ay + 


plp~Wip-2) ns, 


3] Yo + 
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Differentiating it w.r.t. p, we get 


dy 2p 


_ 3p” — 6p +2 
eo 2 a 


6 


1. 
A*yy + APy ++ (1) 
For maxima or minima, dy/dp = 0. Hence equating the right-hand side 
of (1) to zero and retaining only up to third differences, we obtain 


2n-1 3p? —6p +2. 
Ayo + 5 A* yy + P - A*yy =0 


i | 
se (54%s0 Jo + (A?yy — A°yp)p + (Ayo 5A vo zo Yo) =0. 


Substituting the values of Ay,, A’y,, A®y, from the difference table, we 
solve this quadratic for p. Then the corresponding values of x are given by 
x =X, +p, at which y is maximum or minimum. 


EXAMPLE 8.8 


From the table below, for what value of x, y is minimum? Also find this 
value of y. 


x: 3 4 5 6 7 8 
y: 0.205 0.240 0.259 0.262 0.250 0.224 
Solution: 


The difference table is 


x y A Xe AN? 
3 0.205 
0.035 
4 0.240 — 0.016 
0.019 0.000 
5 0.259 — 0.016 
0.003 0.001 
6 0.262 —0.015 
— 0.012 0.001 
7 0.250 — 0.014 
— 0.026 
8 0.224 
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Taking x, = 3, we have y, = 0.205, Ay, = 0.035, A’y, = - 0.016 and 
A®’y, = 0. 


. Newton’s forward difference formula gives 


y = 0.205 + p(0.035) + I) (i) 


Differentiating it w.r.t. p, we have 
= 0.035 + = 

For y to be minimum, dy/dp = 0 

“. 0.035 — 0.008(2p — 1) =0 

which gives p = 2.6875 

“x=x,+ ph =3 + 2.6875 x 1 = 5.6875. 


Hence y is minimum when x = 5.6875. 


! 0.016) 


Putting p = 2.6875 in (i), the minimum value of y 


1 
= 0.205 + 2.6875 X 0.035 + 5 (2.6875 x 1.6875)(— 0.016) = 0.2628. 


EXAMPLE 8.9 


Find the maximum and minimum value of y from the following data: 


x: =2, —l 0 1 2 3 4 
y: 2. — 0.25 0 — 0.25 2 15.75 56 
Solution: 


The difference table is 


se y Ay A’y A*y A‘y A’y 


— 0.25 3 0 
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2 2 
3. | 15.75 
4 56 


Taking x, = 0, we have y, = 0, Ay, =— 0.25, A’y, = 2.5, A®y, = 9, A’y, = 6. 


Newton’s forward difference formula for the first derivative gives 


dy 1 (2p-1) 5  3p'-6p+2.,  4p*-18p +22p-6 , 
1 2x—-1 i 23 1 ’ 
= af e5g— (2.5) +—(3x7 — 6x + 2)(9) + —(4x° — 18x” + 22x —6)(6) 
1 2 6 24 


1 
= gl-0.25 + 2.5% —-1.254+4.5x7 —9x +3422 —4.527 4+5.5x-L5 =x? —x 


l 
For y to be maximum or minimum, a =Oie., x?>—x=0 


dx 
Le., x=0,1,-1 
dy ; 
Now <9 3x? —1 =—-vefor x =0 
dx 
=+ve forx=1 
=+veforx=—l. 
x(x—-1).. 
Since y =Yo txAyy + Ay, +---,y(0)=0 


Thus y is maximum for x = 0, and maximum value = y(0) = 0. 


Also y is minimum for x = 1 and minimum value = y(0) = — 0.25 


Exercises 8.1 


1. Find y’ (0) andy (0) from the following table: 


br: 0 1 2 3 4 5 
y:4 8 15 7 6 p 
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. Find the first, second and third derivatives of f(x) atx = 1.5 if 


x: 15 2.0 2.5 3.0 3.5 4.0 


fix): 3.375 7.000 13.625 24.000 38.875 59.000 


. Find the first and second derivatives of the function tabulated below, at 


the point « = 1.1: 


x: 1.0 12 1.4 1.6 1.8 2.0 
fix): 0) 0.128 0.544 1.296 2.432 4.00 
. Given the following table of values of x and y 
x: 100 | 105 | 110 | 145 ] 120 | 1.295 | 1.30 
y: 1.000 | 1.025 | 1.049 | 1.072 | 1.095 | 1.118 | 1.140 
find Y and 2 ¥ ok (a) x = 1.05. (b) x = 1.25 (c)x = 1.15. 
x dx” 
. For the following values of x and y, find the first derivative at x = 4. 
a: 1 2 4 8 10 
y: 0 i 5 21 27 


. Find the derivative of f(x) at x = 0.4 from the following table: 


x: 0.1 0.2 0.3 0.4 
fix): 1.10517 | 1.22140 | 1.34986 | 1.49182 


. From the following table, find the values of dy/dx and d?y/dx? at x = 2.03. 


x: 1.96 1.98 2.00 2.02 2.04 
y: 0.7825 0.7739 | 0.7651 0. 7563 0.7473 


. Given sin 0° = 0.000, sin 10° = 0.1736, sin 20° = 0.3420, sin 30° = 0.5000, 


sin 40° = 0.6428, 
(a) find the value of sin 23°, 


(b) find the numerical value of cos x at x = 10° 


(c) find the numerical value of d?y/dx? at x = 20° for y = sin x. 


. The population of a certain town is given below. Find the rate of growth 


of the population in 1961 from the following table 


Year: 1931 1941 1951 1961 1971 


Population: 40.62 60.80 71.95 103.56 132.68 
(in thousands) 


10. 


11 


12. 


13. 


14. 


15. 
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Estimate the population in the years 1976 and 2003. Also find the rate of 
growth of population in 1991. 


The following data gives corresponding values of pressure and specific 
volume of a superheated steam. 

v: 9. 4 6 8 10 
p: 105 42.7 95.3 16. 713 


Find the rate of change of 
(i) pressure with respect to volume when v = 2, 


(ii) volume with respect to pressure when p = 105. 


. The table below reveals the velocity v of a body during the specified 


time t find its acceleration at t = 1.1? 


t: 1.0 ual 1.2 1.3 14 
v: 43.1 47.7 52.1 56.4 60.8 


The following table gives the velocity v of a particle at time t. Find its 
acceleration at t = 2. 
t: 0 2 4 6 8 10 12 
v: 4 6 16 34 60 94 131 


A rod is rotating in a plane. The following table gives the angle 6 (radi- 
ans) through which the rod has turned for various values of the time t 
second. 


t: 0 0.2 0.4 0.6 0.8 1.0 1.2 


0: 0 0.12 0.49 1.12 2.02 3.20 4.67 


Calculate the angular velocity and the angular acceleration of the rod, 
when t = 0.6 second. 


Find dy/dx at x = 1 from the following table by constructing a central 
difference table: 


x 0.7 0.8 0.9 1.0 11 1.2 1.3 
y: |0.644218) 0.717356 0 |0.783327 | 0.841471 | 0.891207 | 0.932039 | 0.963558 


Find the value of f’(x) at x = 0.04 from the following table using Bessel’s 
formula. 


X: 0.01 0.02 0.03 0.04 0.05 0.06 


f(x): 0.1023 0.1047 0.1071 0.1096 0.1122 0.1148 
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16. Ify =f(x) andy, denotes f(x, + nh), prove that, if powers of h above h® 
are neglected. 


dt 3 1 1 
(<4) =F — 4-1) EUs =) Z-4-9)} 
[HINT: Differentiate Stiling’s formula w.r.t. x, and put x = 0] 


17. Find the value of f (8) from the table given below: 


: 6 7 9 12 
f (x): 1.556 1.690 1.908 2.158 
18. Given the following pairs of values of x and y: 
a: 1 2 4 8 10 
| y: 0 1 5 21 27 


Determine numerically dy/dx at x = 4. 


19. Find f’ (6) from the following data: 


e: 0 2 3 4 7 8 
f (x): 4 26 58 112 466 922 
20. Find the maximum and minimum value of y from the following table: 
a: 0) 1 2 3 4 D 
y: 0 0.25 0) 9.95 16 56.25 


21. Using the following data, find x for which y is minimum and find this 
value of y. 


e: 0.60 0.65 0.70 0.75 
y: 0.6221 0.6155 0.6138 0.6170 
22. Find the value of x for which f (x) is maximum, using the table 
X: 9 10 11 12 13 14 
f (x): 1330 1340 1320 1250 1120 930 


Also find the maximum value of f (x). 


8.4 Numerical Integration 


The process of evaluating a definite integral from a set of tabulated val- 
ues of the integrand f(x) is called numerical integration. This process when 
applied to a function of a single variable, is known as quadrature. 
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The problem of numerical integration, like that of numerical differen- 
tiation, is solved by representing f(x) by an interpolation formula and then 
integrating it between the given limits. In this way, we can derive quadra- 
ture formulae for approximate integration of a function defined by a set of 
numerical values only. 


8.5 Newton-Cotes Quadrature Formula 


Let 1=f" flx)de 


where f(x) takes the values y,, y,, y,, ++ y, forx =X), %,,%,) +++ X,. 


Let us divide the interval (a, b) into n sub-intervals of width h so that 
X,= a,x, =x, th,x,=x,+ 2h, --- x, =x,+nh=b. Then 


YA 
y = fix) 
Yo Y, Yo Yn 
> 
0 xX), xX +h x,+2h x, tnh XxX 
FIGURE 8.1 


— 1 f (x)dx = hf; f (xo +rh)dr, Putting x =x, + rh, dx = hdr 


hh r(r-l).. r(r—1)(r -2) 
= hf [yo + rAyy aoa A yy +, —— A’yg 
“ r(r— af, 2\(r —3) Aty, is r(ir-Wir- ane —3)(r—4) A®y, 
Ne hse 


[by Newton’s forward interpolation formula] 


Integrating term by term, we obtain 


n(2n —3) 


Xo 


Xq tnh n 
fer" Fedde = ni + 5 Ayo + 
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a n* _3n° 11n° 5 A*yo 
5 2 3 4! 
5 3 2 5 
34 50: A 
fe 0g ee oy | (1) 
6 4 3 5! 
6 5 3 2 6 
15 225 2741 Ay 
so Sie On |e 
7 6 4 3 6! 


This is known as Newton-Cotes quadrature formula. From this gen- 
eral formula, we deduce the following important quadrature rules by taking 
n=1,2,3,... 


I. Trapezoidal rule. Putting n = 1 in (1) and taking the curve through 
(x), Y,) and (x,, y,) as a straight line (Figure 8.2) i.e., a polynomial of first 
order so that differences of order higher than first become zero, we get 


y 
-— 
v T + + t > 


0 Xo x xX, x x, x 


3 
FIGURE 8.2 


1 


xg th 1 h 
Jo fade =h Yo +5 Avo |= 5 (Yo +m) 


re 


vo Xo +2h 1 h 
Similarly Hi x)dx = hl + ra = 3h +y,) 


Xo tnh h 
Soy SNE = Fra tym) 


Xo +(n—-1) 


Adding these n integrals, we obtain 


Xo tnh h 
JO" Fede = Ayo + yu) +2 + Yet" F Yer] — (2) 


Xo 


This is known as the trapezoidal rule. 


NOTE Obs. The area of each strip (trapezium) is found separately. 
———— Then the area under the curve and the ordinates at x, and x, is 
approximately equal to the sum of the areas of the n trapeziums. 
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II. Simpson’s one-third rule. Putting n = 2 in (1) above and taking the 
curve through (x,, y,), (x, y,), and (x,, y,) as a parabola (Figure 8.3), i.e., a 
polynomial of the second order so that differences of order higher than ‘he 
second vanish, we get 


y 
U 
“MU Uh ; e 
0 xX, xy x, v3 


x x 
n 


FIGURE 8.3 


Xyt+2h | eee h 
i, Fide = 2hlyo + Ayo + eo yo) = 5 (Yo + 4m + ye) 


Xo 


Xo tnh h 
Spay f O48 =F nee +My + Yn)» n being even. 


Xo +(n—2)h 


Adding all these integrals, we have when n is even 
Xgtnh h 
f flx)dx= 10 +y, )t4ly tt. --+Vny)t2(Votyat---Vn2)] (3) 
This is known as the Simpson’s one-third rule or simply Simpson’s rule 
and is most commonly used. 


Obs. While applying (3), the given interval must be divided 
into an even number of equal subintervals, since we find the 
area of two strips at a time. 


NOTE 


III. Simpson’s three-eighth rule. Putting n = 3 in (1) above and taking 
the curve through (x, y,): i = 0, 1, 2, 3 as a polynomial of the third order 
(Figure 8.4) so that differences above the third order vanish, we get 


0: x, x 


FIGURE 8.4 


xy +3h 3 3. 1 3 
fo0" Flede = 3h Yo +S Ayy +7 Ayo + ZA yo 


Xo 
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3h 
= 3 Yo + 3y, + 349 + Ys) 
Similarly, 
xg t5h 3h 
ff ~ (x)dx = “3 Ys + 3y, +3y5 + yg) and so on. 
Adding all such expressions from x, to x, + nh, where n is a multiple of 


3, we obtain 


f° +nh fladde z sh 


. gL Yo + Yn) + 3(y1 + Yo + Ya + Ys t+ Ya) (4) 


+2(ys +46 +--+ Yn-3)] 


NOTE Obs. While applying (4), the number of sub-intervals should be 
taken as a multiple of 3. 


IV. Boole’s rule. Putting n = 4 in (1) above and taking the curve (x, y,), 
i=0, 1, 2, 3, 4 as a polynomial of the fourth order (Figure 8.5) and neglect- 
ing all differences above the fourth, we obtain 


y 
U 
F 4 Ys My, : Y4 
> 


0 x, x, x, %, Xe x 


FIGURE 8.5 


xy +4h ae 2 7 
Jor flide = 4h [v + 2Ayy +5 A’ yo = ZA’ yo + oA yo 


Xo 


2h 
= Yo = 32y, + 12y, + 32y35 + 7y,) 


xg t8h ah 
Similarly i ‘i f (x)dx = EL + 32y5 + 12y, +32y, +7ys) and so on. 


Adding all these integrals from x, to x, + nh, where n is a multiple of 4, 
we get 
Qh 
a f (x)dx = 5 Yo + 32y, +12y, +32y3 +14y, +32y5 (5) 
i +12y, +32y, + 14y, ++ 


This is known as Boole’s rule. 


Obs. While applying (5), the number of sub-intervals should be 


NOTE taken as a multiple of 4. 
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V. Weddle’s rule. Putting n = 6 in (1) above and neglecting all differ- 
ences above the sixth, we obtain 


xo t+6h 9. 123 
J. ‘ f(x)dx = ah (y + 3Ayy +o A°yy +4A° yo + ANY 


Xo 


If we replace = Ay by Ay, the error made will be negligible. 


Xyt+6h 3h 
J: (aide =7) Yo + di + yo + 6y3 + yy + Sys + yg) 


Similarly 


xo t12h 3h 
J ton JE = TH Ye +547 + Ys + 6 Yo + tio +54n1 + Yio) and so on. 


Adding all these integrals from x, to x, + nh, where n is a multiple of 6, 
we get 
x tnh | 
f . flade=— (yo + 5y, + yy + 6y3 + yy + 5y5 + 2yg + 5y, + yg +°-:) (6) 
This is known as Weddle’s rule. 


Obs. While applying (6), the number of sub-intervals should 


NOTE "be taken asa multiple of 6. Weddle’s rule is generally more 
accurate than any of the others. Of the two Simpson rules, the 
1/3 rule is better. 

EXAMPLE 8.10 


Evaluate i ; ' a x by using 
(i) Trapezoidal rule, 

(ii) Simpson’s 1/3 rule, 

(iii) Simpson’s 3/8 rule, 

(iv) Weddle’s rule and compare the results with its actual value. 
Solution: 


Divide the interval (0, 6) into six parts each of width h = 1. The values 


of f(x) = 


= are given below: 


1l+x 
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x 0 1 2 3 A 5 6 
fix) i 0.5 0.2 0.1 0.0588 | 0.0385} 0.027 
ay Yo vin Yo Ys Ya Ys Yo 
(i) By Trapezoidal rule, 
dx h 
pelee 2 Yo t+ Y6) + Ay, + Yo + y3 + Ya + Y5)1 
0 


1 
= gl + 0.027) + 2(0.5 + 0.2 +0.1+ 0.0588 + 0.0385)| = 1.4108. 


(ii) By Simpson’s 1/3 rule, 


6 dx _h 
iF Tee gl + yg) FAY, + Y3 + Ys) + Ys + Ya 
1 


= gilt + 0.027) + 4(0.5 + 0.1 + 0.0385) + 2(0.2 + 0.0588) ] = 1.3662. 
(iii) By Simpson’s 3/8 rule, 


6 dx _ 3h 
Se = ldo + 46) F3y 1 + Yo + Ys + Ys) + 2yp] 
1l+x 8 


— =[(1 + 0.027) + 3(0.5 + 0.2 + 0.0588 + 0.0385) + 2(0.1)] = 1.3571 
(iv) By Weddle’s rule, 


6 dx 3h 
J, l+x° = To ve +5y, + Yo + 6y3 + yy + 5y5 + yo] 
= 0.3[1 + 5(0.5) + 0.2 + 6(0.1) +0.0588 +.5(0.0385) + 0.027] = 1.3735 


6 dx -1_|6 7 
Also boas =|tan "|? = tan | 6 = 1.4056 
x 


This shows that the value of the integral found by Weddle’s rule is the 
nearest to the actual value followed by its value given by Simpson’s 1/3 rule. 


EXAMPLE 8.11 


9 
. tox . . ; 
Evaluate the integral i é ——zdx using Simpson’s 1/3 rule. Compare 
the error with the exact value.! t * 


Solution: 


Let us divide the interval (0, 1) into 4 equal parts so that h = 0.25. 


2 
Taking y= - we have 
(l+x°)’ 
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Xi 0 0.25 0.50 | 0.75 1.00 
y: 0 = |0.06153)0.22222/0.39560| 0.5 
Yo yy Ys Ys U4 


By Simpson’s 1/3 rule, we have 


\e=3 “Ly + y4)+2(yo)+4(y, +y3)] 


-"= [(0 + 0.5) + 2(0.22222) + 4(0.06153 + 0.3956)] 


0.25 
aa [0.5 + 0.44444 + 1.82852] = 0.23108 


5 1 
x 1 3 1 9=(0< 
Algo f ah = sllogta +x I. = 3 1°6 e2 = 0.23108 


Thus the error = 0.23108 — 0.23105 = — 0.00003. 


EXAMPLE 8.12 


Use the Trapezoidal rule to estimate the integral { 5 2 dx taking the 


number 10 intervals. 


Solution: 
Let y = ex”, h =0.2 andn = 10. 


The values of x and y are as follows: 


0.2 0.4 0.6 0.8 1.0 1.2 14 1.6 18 2.0 


1.0408 | 1.1735 | 1.4333 | 1.8964 | 2.1782 | 4.2206 | 7.0993 |12.9358]25.5337|54.598 1 


yy Yo Ys Ya Ys Yo Y, Ys Yo Yio 


By the Trapezoidal rule, we have 


Lis h 
{ ede =s1yo + Yio) FAY, + Yo + Ys + Y4 + Ys + Y6 + Yr + Ys + Yo)! 
0.2 
= [1 + 54.5981) + 2(1.0408 + 1.1735 + 1.8964 + 2.1782 
+4,2206 + 7.0993 + 12.9358 + 25.5337)]| 


2 2 
Hence J, e* dx =17.0621. 
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EXAMPLE 8.13 


06. 
Use Simpson’s 1/3rd rule to find f ; e dx by taking seven ordinates. 
Solution: 


Divide the interval (0, 0.6) into six parts each of width h = 0.1. The val- 


ues of y= f(x) = e* are given below: 


x 0 0.1 0.2 0.3 0.4 0.5 0.6 

xe 0 0.01 0.04 0.09 0.16 0.25 0.36 

y 1 0.9900 | 0.9608 | 0.9139 | 0.8521 | 0.7788 | 0.6977 
Yo y Yo Ys Y4 Ys Yo 


By Simpson’s 1/3rd rule, we have 
2, h 
e* dx = Tyo + ys) + Alyn + Ys + Ys) + Ayo + y4)] 
0.6 0.1 
f A = 3 lal + 0.6977) + 4(0.99 + 0.9139 + 0.7788) + 2(0.9608 + 0.8521) | 


_ 0. 1 
3 —|1.6977 + 10.7308 + 3.6258] = 3 OP ae 0543) = 0.5351. 


EXAMPLE 8.14 


Compute the value of fi (sinx —logx +e*)dx using Simpson’s 3/8 
rule. 


Solution: 
Let y = sin x — loge x + e* andh =0.2,n =6. 


The values of y are as given below: 


x: 0.2 0.4 0.6 0.8 1.0 1.2 14 
y: 3.0295 | 2.7975 | 2.8976 | 3.1660 | 3.5597 | 4.0698 | 4.4042 
Yo Yy Ys Ys Y4 Ys Yo 


By Simpson’s 3/8 rule, we have 


Sf. yo = [Yo + Yo) + Alys) + 3(y, + Yo + Ys t+ Y5)] 


: 
= 3g 0-217. 7336 + 2(3.1660) + 3(13.3247)] = 4.053 
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14 bare 
Hence J... (sinx —loge* + e*)dx = 4.053. 


NOTE 


Obs. Applications of Simpson’s rule. If the various ordinates 
in Section 8.5 represent equispaced cross-sectional areas, then 


Simpson’s rule gives the volume of the solid. As such, Simpson’s 
rule is very useful to civil engineers for calculating the amount 
of earth that must be moved to fill a depression or make a dam. 


Similarly if the ordinates denote velocities at equal intervals 
of time, the Simpson’s rule gives the distance travelled. The 


following Examples illustrate these applications. 


EXAMPLE 8.15 


The velocity v(km/min) of a moped which starts from rest, is given at 


fixed intervals of time t (min) as follows: 
t: 2 4 6 8 10 12 14 16 18 20 
vO: 10 18 25 29 32 20 ll 5 2 0 


Estimate approximately the distance covered in twenty minutes. 


Solution: 


If s (km) be the distance covered in t (min), then & =v 


20 — 
|s t=0 


Here h = 2, v, = 0, v, = 10, v, = 18, v, = 25 ete. 
X=v,+0,,=9+0=0 


O=0,+0, +0, +0,+0,= 10+ 25+ 32+ 11+2=80 


dt 


E=0,+0,+0,+0,=18 + 29 + 20+5 =72 


20 h 
f, vdt = 3x +4.0+2.E], by Simpson’s rule 


‘ 2 
Hencethe required distance = |s|;°,, = 30 +4 x80+2 X72) = 309.33km. 


EXAMPLE 8.16 


The velocity v of a particle at distance s from a point on its linear path 
is given by the following table: 


s (m): 


2.5 


12.5 


15.0 


17.5 


v (m/sec): 


16 


19 


17 


13 


11 
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Estimate the time taken by the particle to traverse the distance of 20 
meter, using Boole’s rule. 


Solution: 


ds 
If t sec be the time taken to traverse a distance s (m) then i =v 


a dr 1 a 
—=—=  y(say), 
ds wv ade 

= 20 
then leo =), : yds 
Here h=2.5andn=8 
1 1 1 1 1 
Also Yo = 167 ft = 19792 = 4798 = 99°44 = 90° 
1 1 wt 


$5 p46 1347 748 ~ 9 


‘. By Boole’s Rules, we have 


7 2h 
lel’ et yds =“ [Typ +324, + 312ys + 14yy +32ys + 12y5 + 32y, + 14y] 


ABE GeGhoaieds 


ee) 


Hence the required time = 1.35 sec. 


1 
= 5 (1211776) = 1.35 


EXAMPLE 8.17 


A solid of revolution is formed by rotating about the x-axis, the area 
between the x-axis, the lines x = 0 and x = 1 and a curve through the points 
with the following co-ordinates: 


x: 0.00 0.25 0.50 0.75 1.00 
y: 1.0000 | 0.9896 | 0.9589 | 0.9089 | 0.8415 


Estimate the volume of the solid formed using Simpson’s rule. 
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Solution: 
Here h = 0.25, y, = 1, y, = 0.9896, y, = 0.9589 etc. 


. Required volume of the solid generated 


1, ho. ‘ ‘ i 
=f ayde= (yo tye) + Aly” + ys") + 2yo"] 


— 9.7571 7 4 9.8415)°} +4{(0.9896)? + (0.9089)?} + 2(0.9589)"] 


0.25 X 3.1416 
= —————[1.7081 + 7.2216 + 1.839] 


= 0.2618(10.7687) = 2.8192. 
Exercises 8.2 


i 
1. Use trapezoidal rule to evaluate f ; xdx considering five sub-intervals. 


1 dx 
2. Evaluate f nie applying 
(i) Trapezoidal rule 
(ii) Simpson’s 1/3 rule 
(iii) Simpson’s 3/8 rule. 


1 dx : 
3. Evaluate f ee using 
(i) Trapezoidal rule taking h = 1/4. 
(ii) Simpson’s 1/3rd rule taking h = 1/4. 
(iii) Simpson’s 3/8th rule taking h = 1/6. 
(iv) Weddle’s rule taking h = 1/6. 
Hence compute an approximate value of @ in each case. 


4. Find an approximate value of loge 5 by calculating to four decimal 


places, by Simpson’s 1/3 rule, f 5 dx 
equal parts. 0 4x + 


dividing the range into ten 


4 " . > . ; 
5. Evaluate i. of dx by Simpson’s rule, given that 
e = 2.72, e? = 7.39, e? = 20.09, et = 54.6 


and compare it with the actual value. 


6 e 
6. Find —dx using Simpson’s 1/3 rule. 
Ool+x 
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2 
7. Evaluate i, ’ e dx, using Simpson’s rule. (Take h = 0.25) 
8. Evaluate using Simpson’s 1/3 rule, 


a 
(i) i » Sinxdx, taking eleven ordinates. 
12 
(ii) i ” eos Odd, taking nine ordinates. 
0 


9. Evaluate by Simpson’s 3/8 rule: 


. £2 dx 
Ol Pewee: 


m/2 . 
(ii) sinxdx 
0 
ae al sinx 
iii ends 
(iii) J, d 


(iv) J; (1 +3cos” 6) dé, using six ordinates 


10. Given that 
x: 4.0 4.2 4.4 4.6 4.8 5.0 5.2 
log x: | 1.3863 | 1.4351 | 1.4816 | 1.5261 | 1.5686 | 1.6094 | 1.6487 


52 
evaluate f } logxdx by 
a) Trapezoidal rule 
b) Simpson’s 1/3 rule, 
c) Simpson’s 3/8 rule, 
d) Weddle’s rule. 


Also find the error in each case. 


( 
( 
( 
( 


m/2 
11. Use Boole’s five point formula to compute ih , {(sinx) / dx 
12. The table below shows the temperature f (t) as a function of time: 


t: il 2 3 4 5 6 7 
f @): 81 75 80 83 78 70 60 


1 7 
Using Simpson’s = rule to estimate f , f(t)dt. 


13. 


14. 


15. 


16. 


17. 


18. 
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A curve is drawn to pass through the points given by the following table: 
x: 1 1,5 2 2.5 3 3.5 4 
2 2.4 2.7 2.8 3 2.6 2.1 


Estimate the area bounded by the curve, x-axis and the lines x = 1, x = 4. 


A river is 80 feet wide. The depth d in feet at a distance x feet. from one 
bank is given by the following table: 


x: 0 10 20 30 40 50 60 70 80 


y: 0 4 7 9 12 15 14 8 3 
Find approximately the area of the cross-section. 
A curve is drawn to pass through the points given by the following table: 
x: 1 Ib 2 9D 3 3.5 4 
y: 2 2.4 2.7 2.8 3 2.6 2.1 


Using Weddle’s rule, estimate the area bounded by the curve, the x-axis, 
and the lines x = 1, x =4. 


A curve is given by the table: 


x: 0 1 2 3 + 5 6 
y: 0 2 2.5 2.3 21. 71. 5 


The x-coordinate of the C.G. of the area bounded by the curve, the end 
ordinates, and the x-axis is given by AX = ; xydx, where A is the area. 
Find x by using Simpson’s rule. 

A body is in the form of a solid of revolution. The diameter D in cms of 
its sections at distances x cm. from one end are given below. Estimate 
the volume of the solid. 

x: 0 2.5 5.0 7:0 10.0 12.5 15.0 
D: 5 5.5 6.0 6.75 6.25 5.5 4.0 


The velocity v of a particle at distance s from a point on its path is given 


by the table: 


s ft: 0 10 20 30 40 50 60 
v ft/sec:| 47 58 64 65 61 52 38 


Estimate the time taken to travel sixty feet by using Simpson’s 1/3 rule. 
Compare the result with Simpson’s 3/8 rule. 
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19. The following table gives the velocity v of a particle at time t: 


0 4 6 8 10 
4 16 34 60 94 


2 
6 


12 
136 


t (seconds): 


v (m/sec.): 


Find the distance moved by the particle in twelve seconds and also the 
acceleration at t = 2 sec. 

20. A rocket is launched from the ground. Its acceleration is registered 
during the first eighty seconds and is given in the table below. Using 
Simpson’s 1/3 rule, find the velocity of the rocket at t = 80 seconds. 


t (sec): 0 10 20 
Lf (em/sec2): 30 31.63 | 33.34 


30 40 50 60 70 80 
35.47 | 37.75 | 40.33 | 43.25 | 46.69 | 50.67 


21. A reservoir discharging water through sluices at a depth h below the 
water surface has a surface area A for various values of h as given below: 


If ¢ denotes time in minutes, the rate of fall of the surface is given by 
dh/dt = — 48N h/A. 

Estimate the time taken for the water level to fall from fourteen to ten 
feet above the sluices. 


8.6 Errors in Quadrature Formulae 


The error in the quadrature formulae is given by 


E= ff yde—f" Pleas 
where P(x) is the polynomial representing the function y = f(x), in the in- 
terval [a, b]. 


Error in Trapezoidal rule. Expanding y = f(x) around x = x, by Taylor’s 
series, we get 


' (o= x )? ” 
Y= Yo +(x— Xp )Yo +9 Fis 
a. (1) 
Xo th xoth ; (x—x : ‘ 
” J yde= J [yo + (x— Xo )Yo +) Yo +...Jdx (2) 


2 


3 
h ’ h ” 
=yo +s) Yo +r ig Pass 
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1 
Also A, = area of the first trapezium in the interval [x),x,]= 3 Yo + y,) (3) 


2 


Putting x =x, +h andy =y, in (1), we get y, = yy thyo + Yo. +... 
Substituting this value of y, in (3), we get 


1 es ae 
Ay = 1H + yy +hyo +5 Yo +] (4) 


h? we 
=hyy +> Yo +5914 +... 


. Error in the interval [x ,x1]= f ydx — A, [(2) — (4)] 
am 1 1 3 00 = h> ”" 
= el” Yo Tot Pils 
h? ”" 


i.e., Principal part of the error in [xy,x,]= —T5 Yo 


3 
Hence the total error E= — ty +y, +...+y"4] 


Assuming that y"(X) is the largest of the n quantities Yo sYf1_»+-Y"_1 we 
obtain 
nh? = a)h" 
12 12 
Hence the error in the trapezoidal rule is of the order h’. 


y"(X) ls nh =b—a...(5) 


Error in Simpson’s 1/3 rule. Expanding y = f(x) around x =x, by Taylor’s 
series, we get (1). 


. Over the first doubt strip, we get 


Xg Xp 2h / (x -—x ‘a i 
de pda = is y. r " ~~ Yo 7 a Y ci fs mt 


Ah? § SR ow TGR we BOR” 


Also A, = area over the first doubt strip by Simpson’s 1/3 rule 
1 
= 3 hyo +4y, + Ys) (7) 
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Putting x =x, +h and y =y, in (1), we get 
ry ee wi 
= yo thyo + ta Yo +... 
Again oe x=x,+ 2h aaa a = =i; in (1), we have 


mr 


' Ah? " 
Yo = Yo + 2hyy + Yo ty Yo ai aed 


Substituting these values of y, and y, in (7), we get 


h h? 
Aves ars yo + hyo + Yo eh 


' Ah? " Sh? my 
+| 2hyo $5 0 Fg oo 


[5 a Ah? ”" Qh? m 5h? iv 
= 2hyy + 2h" yo +H tH +564 tt (8) 
*. Error in the interval [x,, x,] 
= f° ydx — 4,=(3- oi yt + [(6) — (8)] 
i.e., Principal part of the error in [x,, x,] 
= (= a2 =) 5 iv : iw 
15 1s) ~~ 90% 
We 
Similarly principal part of the error in [v2.44] = oo %2- and so on. 
ae ; 
Hence the total error E= =o tyy” ++ y"2(n—1)] 
Assuming the y'*(X) is the largest of y,'", y,”, ..., y'’,, 5, we get 
nh? iw (b 7 ayh* iw oe C 
E<—— wo 6 caer y'?(X) [.° 2Inh =b —a...(9)] 


i.e., the error in Simpson’s 1/3 -rule is of the order h*. 


Error in Simpson’s 3/8 rule. Proceeding as above, here the principal part 
of the error in the interval [x,, x,] 


3h, 
— w 10 
80 / M0) 
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Error in Boole’s rule. In this case, the principal part of the error in the 


interval 

an) =e y” (11) 
Error in Weddle’s rule. In this case, principle part of the error in the 
interval 

es a] = Tao Yo (12) 


8.7 _Romberg’s Method 


In Section 8.5, we have derived approximate quadrature formulae with 
the help of finite differences method. Romberg’s method provides a simple 
modification to these quadrature formulae for finding their better approxi- 
mations. As an illustration, let us improve upon the value of the integral 


T= ff" fidx, 
by the Trapezoidal rule. If I,, I, are the values of I with sub-intervals of 


width h,, h, and E,, E, their corresponding errors, respectively, then 


b-ah, baerhs 
E, = Cn H"(X), Ey =o ®) 


Since y"(X) is also the largest value of y"(x), we can reasonably assume that 


y"(X) and y"(X) are very nearly equal. 


Ey _hy E, hy 
E, hy E, — Ey hy” = hy 


Now since [=I1, + E, =1, + Ey, 
E,-E,=1,-1, (2) 
From (1) and (2), we have 


E hy" (I, —I,) 
1 he 42 1 2 
hy . Ths” —Lh;° 
Hence I=1L,+E, =I, 72 ab ie., 1= hye — hy (3) 


which is a better approximation of I. 
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1 
To evaluate I systematically, we take h, =h and hz = Pil 
L(h/2)—-I,h.” 41, -1, 


so that (3) gives J = #3 = 
(h/ 2) —h? 3 


ie, Uh.h/2)= lath /2)- 100) (4) 


Now we use the trapezoidal rule several times successively halving h 
and apply (4) to each pair of values as per the following scheme: 


I(h) 
I(h, h/2) 
I(h/2) I(h, h/2, h/4) 
I(h/2, h/4) I(h, h/2, h/4, h/8) 
I(h/4) I(h/2, h/4, h/8) 
I(h/4, h/8) 
I(h/8) 


The computation is continued until successive values are close to each oth- 
er. This method is called Richardson’s deferred approach to the limit and 
its systematic refinement is called Romberg’s method. 


EXAMPLE 8.18 
1 
Evaluate 
Ja 


dx 


correct to three decimal places using Romberg’s 
+x 


method. Hence find the value of log, 2. 
Solution: 


Taking h = 0.5, 0.25, and 0.125 successively, let us evaluate the given inte- 
gral by the Trapezoidal rule. 


(i) When h = 0.5, the values of y = (1 + x)-! are: 
x 0 0.5 1 
Y: 1 0.6666 0.5 

I= au +0.5 +2 X 0.6666) = 0.7083. 


(ii) When h = 0.25, the values of y = (1 + x)" are: 


Xx: 0 0.25 0.5 0.75 1 
Yy: 1 0.8 | 0.6666) 0.5714} 0.5 
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_ 0.25 


4 


(iti) When h = 0.125, the values of y = (1 +)" are: 


I [(1 + 0.5) + 2(0.8 + 0.666 + 0.5714)| = 0.697 


x: 0 0.125 | 0.25 | 0.375 | 0.5 | 0.625 | 0.75 | 0.875 1 


y: 1 0.8889 | 0.80. | 7272 | 0.6667 | 0.6153 | 0.5714 | 0.5333 | 0.5 


[= a + 0.5) + 2(0.8889 + 0.8 + 0.7272 + 0.6667 


+0.6513 + 0.5714 + 0.5333)] 
= 0.6941 


Using Romberg’s formulae, we obtain 


Ih,h/2)= lath /2)-1h)]= si4 x 0.697 — 0.7083] = 0.6932 


Ih/2,h/4)= (anh /4)—I(h/2)]= l4 x.0,6941 — 0.697] = 0.6931 


Ih,h/2,h/4)= lath /2,h/4)—I(h,h /2)]|=0.6931 


1 dx 
Hence the value of the integral f —— = 0.693 (i) 
Ool+x 
Also a llog(1 +x), =log2 (ii) 
Ool+x 8 “10 5* 


Hence from (i) and (ii), we have 


log 2 = 0.693. 


EXAMPLE 8.19 
: 1 dk 
Use Romberg’s method to compute f © correct to four decimal 
places. ea 
Solution: 


We take h = 0.5, 0.25 and 0.125 successively and evaluate the given 
integral using the Trapezoidal rule. 


(i) When h = 0.5, the values of y = (1 + x’)! are 


x: 0 0.5 1.0 
y: 1 0.8 0.5 
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[= °F +2%x0.8 X 0.5) = 0.775 


(ii) When h = 0.25, the values of y = (1 + x”)! are 


x: 0 0.25 | 05 | 0.75 | 1.0 
y: 1 |09412/ 08 | 064 | 05 
0.25 
- L= [1 + 2(0.9412 +0.8 +0.64) + 0.5] = 0.7828 


(iti) When h = 0.125, we find that I = 0.7848 
Thus we have 
I(h) = 0.7750, I(h/2) = 0.7828, I(h/4) = 0.7848 


Now using (4) above, we obtain 


— 


h,h/2)= lan /2)—1h)|= 731312 — 0.775) = 0.7854 


T(h/2,h/4)= llanh /4)-I(h/2))|= 5 (3.1392 — 0.7828) = 0.7855 


T(h,h/2,h/4)= s[4tth/2,h /4)—I(h,h/2)\= +(3.142- 0.7854) = 0.7855 


“. The table of these values is 


0.7750 
0.7854 

0.7828 0.7855 
0.7855 

0.7848 


Hence the value of the integral = 0.7855. 


EXAMPLE 8.20 


osf x 
Evaluate the integral ( is 


: fi using Romberg’s method, correct 
to three decimal places. 0 \sinx 
Solution: 


Taking h = 0.25, 0.125, 0.0625 successively, let us evaluate the given 
integral by using Simpson’s 1/3 rule. 
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(i) When h = 0.25, the values of y = sinx ore 
as 0 0.25 0.5 
y: 1 1.0105 1.0429 
Yo Yi Ys 


.. By Simpson’s rule, 
I= *Liyo +5) +4y,]= a + 1.0429) + 1.0105] 
= 0.5071 
(ii) When h = 0.125, the values of y are 


x: 0 0.125 0.25 0.375 0.5 
y: 1 1.0026 1.0105 1.1003 1.0429 
Yo yy Ys Y, Y4 


. By Simpson’s rule 


h 
T=—l(yo + y4)+4(y, +y3) + 2y2] 


0.125 
= la + 1.0429) + 4(1.0026 + 1.1003) + 2(1.0105)] 


= 0.5198 
(iii) When h = 0.0625, the values of y are 


x: | O | 0.0625) 0.125 |0.1875} 0.25 | 0.3125 | 0.1875 | 0.4375 | 0.5 


y: | 1 | 0.0006 | 1.0026 | 1.0059 | 1.0157 | 1.0165 | 1.1003 | 1.0326 | 1.0429 


Hy | Yo Ys Ys Ys Yo Ys Ys 
‘. By Simpson’s rule: 
h. 
I = 3 ly + ys) +4(y, +Y3 + Y5 + yz) + Yo + yy + Yo) 


_ 0.0625 


[(1 + 1.0429) + 4(1.0006 + 1.0059 + 1.0165 + 1.0326 


+2(1.0026 + 1.0105 +1.1003)] 
= 0.510253 
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Using Romberg’s formulae, we obtain 


hy _ 1) (h\_ aay leo. 
Uh.) = +|41(4) 1) = 0.5241 


1,2) =1|a(7)-1(2)]=o.5070 
9°4° 3{ \4 2 


rn y= 2] (3. *)- i(h.2}]=05013 


24 3 2°4 2 


05{ x 
Hence f = dx = 0.501 
0 \sinx 


8.8 Euler-Maclaurin Formula 


Taking AF(x) = f(x), we define the inverse —— Aas 


F(x) =A" fix) 
Now F(x,) — F(x,) = AF(x,) =e 
Similarly, F(x,) — F(x,) =f(x,) 


Adding all these, we get 


F(x,) = Flt) = >, fx) (2) 
i=0 
where x,, X,, ..... x, are the (n + 1) equispaced values of x with differ- 
ence h. 
From ove we have 
=A! f(x) =(E+1) 1! f(x) =(e - 1)! f(x) [-.- E = ehD] 
hp? p> ib 
eto rT + 31 |-1] f (x) 
= 
apple 
= (hD) Ls i a flx) i 
ieee hD h?D? h‘p* 
aa [ 32° 12 70 
i 1 h h° 
=> f flalde—5 fad+ 5 FW -f"@) 
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Putting x =x, and x =x, in (3) and then subtracting, we get 


1 rx 1 h 
EG, ) = Fg) = ae f (x)dx ~ al flan) = f (xo )I+ lf Gn) r 
h? 
f( ol zp lh"n) f(x + 
“. From (2) and (4), we have 
n-1 l " l i 
Df a I, Fees 5 UF lom)~ Flood) sSLF Uo) 
h? 
Fo Teo LP in) — Fo I+ 
1 uo 1 h 
te fh fake D flo s1FG0)~ Fool BLF es) 
3 
=F ot ogle" an) f(x) + 
=—| flag) 2H (ay) taf ae) te Po fa) +) 
ay CO a a ie "ey = Fig) + 
12 f Xn 7 0) 720 ci Xn) 7 Xo 
Hence fon yas = Aly + 2y, +2y +++ 2y,-1 ty, 1] (5) 
2 ht m m 


5 Yn —Yo )+ 50 Yn =.) ties 


which is called the Euler-Maclaurin formula. 


Obs. The first term on the right-hand side of (5) represents the 
approximate value of the integral obtained from trapezoidal 
rule and the other terms denote the successive corrections to 
this value. This formula is often used to find the sum of a series 


of the form 


NOTE 


y(x,) ty(x, th) +... + y(x, + nh). 


EXAMPLE 8.21 


Using the Euler-Maclaurin formula, find the value of loge 2 from 


1 dy 
he 
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Solution: 


Taking y= 


ie a =0,n=10,h =0.1,we have 
x 


' d mr —6 
y =-—— and y”=——_. 
I 4x2 o (+2) 


Then the Euler-Maclaurin formula gives 
1 dx mal 1 2 2 2 2 
f tes + + + + 
Ol+x 241+0 1+4+01 1402 1403 %1+4+0.1 
+ + + + + + 
1+05 1+06 1+0.7 1+08 14+09 141 


_0.1| -1 _ -1 |, ("| -6 _ -6 
12 |deiy c+0 720 }(1+1)* (1+0)* 
= 0.693773 — 0.000625 + 0.000002 = 0.693149 
doe vp 2 
Also Ste llog(1 + »)), = loge 


Hence log, 2 = 0.693149 approx. 


EXAMPLE 8.22 


Apply the Euler-Maclaurin formula to evaluate 


a a 
; 51? 537 «557 gg? 
Solution: 
1 Uy =2 mm —24 
Taking y=, x, =51, h=2,n = 24, we have y’=—,y" =—3- 
x x Xx 


Then the Euler-Maclaurin formula gives 


feG-3 ato t +o 
sig” 21517 565% 5° 97" 907 


2/2 -3).2) 4 


12 L99° 512] 720L 99° 515 
1 1 z 1 Ade 1 sf 2 
51? 537 5B? gg? 4 51 x” 
1/1 1 1/1 1 8/1 1 
= a ae 3 gQ3} ree il 
2\51° 99 B\51° 99" 30\51° 99 
99 
=—|-| +0.000243 + 0.0000022 —...= 0.00499 approx. 
4/X151 
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8.9 Method of Undetermined Coefficients 


This method is based on imposing certain conditions on a preassigned 
formula involving certain unknown coefficients and then using these condi- 
tions for evaluating these unknown coefficients. Assuming the formula to 
be exact for the polynomials 1, x, 4, x" respectively and taking y, for y(x,), we 
shall determine the unknown coefficients to derive the formulae. 


Differentiation formulae. We first derive the two-term formula by as- 
suming 

Yo = aot GY (1) 
where the unknown constants a,, a, are determined by making (1) exact for 
y(x) = 1 and x respectively. 


So, putting y(x) = 1, x successively in (1), we get 
O=a,t+a,and l=a,x,+a,(x, +h) 


where a, = Wh anda,=- Wh. 
1 
Hence Yo = 7 =, ) (2) 


The three-term formula can be derived by taking 
Yo = 494 Fay tayy (3) 


where the unknowns @_,, d,, a, are determined by making (3) exact for y(x) 
= 1, x, x’, respectively. 


O=a,t+a,+a, 
l=a, (x,-h) +a,x,+a,(x, +h) 
and 2x, =a_, (x,-hP+an, ta(x, + hy. 

To solve these equations, we shift the origin to x, i.e., x, =0. As such, Yo 
being slope of the tangent to the curve y = f(x) at x =x, remains unaltered. 
Thus the equations reduce to 

a_,+a,t+a,=0, 
-a_,+a,=\Whanda_,+a,=0, 
giving a_,=- 2h, a,=0, a, = 1/2h 


i 
Hence Yo = al —y-); (4) 
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Similarly for second order derivative, taking 


Yo = 419-1 + agYo tq; 


and making it exact for y(x) = 1, x, x? and putting x, = 0, we get 
g ] P 8X g 


” 1 
Yo =Faln — 2yy +y_;) (5) 


Integration formulae. The two-term formula is derived by assuming 


Xo th 
1 ydx = ayy tay (6) 


where the unknowns a0, al are determined by making (6) exact for 
y(x) = 1, x respectively. 


So putting y(x) = 1, x successively in (6), we get 
Xo th 
ayta,=f" lede=h 


Xo 


xg th 
AyXy +4,(xXy +h) = f’ xdx= 


1 
. 9 Ho +h) -x5] 


To solve these, we shift the origin to x, and take x, = 0. 


*. The above equations reduce to 


1 1 
a) +a, =h and a, =—h, whence a, =—h,a) ==h 
2 2 ae 


xg th h 
Hence if — ydx= 3 Yo ty,) which is trapezoidal rule. (7) 
The three-term formula is derived by assuming 
Xoth 
‘ia ydx = a_,y_; + ayy + ayy, (8) 
where the unknowns @_,, d,, a, are determined by making (8) exact for y(x) 
= 1, x, x’ respectively. 
So putting y = 1, x, x° successively in (8), we obtain 
xy th 
a_, ta) +a, =F ie 1-dx=2h 


Xo th 2 
y(t —h) + agro tal +h) = f xde= [lay +h) =(oh)'] 


Xg—h 


5 ‘ xo th 
ylty =h) + agxe? + ay (xy +h? =f Pd =Zll0%9 +H) = (x9 


X0-h 
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To solve these equations, we shift the origin to x, and take x, = 0. 
“. The above equations reduce to 

2 
a_,+4a,t+4,=2h,-a_,+a,=0and a, +a, | 


1 4 
Solving these, we get d_, = A = 4,4) = a0 


xg th 


Hence { - ydx = Fy. + 4y,) +y,) which is Simpson’s rule. (9) 


8.10 Gaussian Integration 


So far the formulae derived for evaluation of f : f (x)dx, required the 


values of the function at equally spaced points of the interval. Gauss derived 
a formula which uses the same number of functional values but with differ- 
ent spacing and yields better accuracy. 


Gauss formula is expressed as 
n 


Ji, Fedde = w, fly) + w flay) +--+ w, fl) = Swifle,) (1) 


i= 


where wi and xi are called the weights and abscissae, respectively. The ab- 
scissae and weights are symmetrical with respect to the middle point of the 
interval. There being 2n unknowns in (1), 2n relations between them are 
necessary so that the formula is exact for all polynomials of degree not ex- 
ceeding 2n — 1. Thus we consider 


f (x) = cy HEX togx $+ +05, 07" | (2) 
Then (1) gives 
1 1 
f_ fleiax = Fo + Cx + CoX Se ean \dx (3) 


oe ae eae 
= 2c) t=, toc, +°:: 
re ae 


Putting x =x, in (2), we get 


ee 2 3 2n-1 
FQ j= Gy Fe,x, + Oy Fer, Hic 6,15; 
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Substituting these values on the right hand side of (1), we obtain 
1 ; On 
J flax =wl(cy tex, tegxy? tegxp> +...Cop Xo” 
OC Ot tee Or tae 


5 or a3 - 2n-1 
TOGO OR Oe hye ) 


ONC +O Mi Per hea re <7) 


=¢, (Wt wt WF os FO) ci (wat wn he Fe Pe: x) 
OUD KP FAD, 0 AO Ob oe tb 7) 
- 2n-1 > x In-1 - 2n-1 wae, > x 2n-1 
18s, Oe ee a ee ee) A) 


But the equations (3) and (4) are identical for all values of c,, hence 
comparing coefficients of c,, we obtain 2n equations in 2n unknowns w, and 
tlie, 2. ase Nn). 


w, tw, twst+--+ w, =2 


WX, + WeXy + W3X3 +--+ wW,X, =O 
2 
is 6 2 C 
WX)? HK WoXo” FH Wake te +w,x,2 =— (5) 
1*1 22 343 nn 3 
2n-1 2n-1 2n-1 2n-1 
Wx, PR tbekg F egxg Fee Fx, = 0 
A lb 22. 3°38 n’n 


The solution of the above equations is extremely complicated. It can 
however, be shown that x, are the zeros of the (n + 1)th Legendre polyno- 
mial. 


Gauss formula for n = 2 is 


Hf 
Jo Flodde = wy fly) + w2 fla) 
Then the equations (5) become 
w, +W, =2 


WX, + WoX, =O 


w x, + WX5° = 
Solving these equations, we obtain 


w,=w,=1,x,=—- 13 andx, = 1/3. 
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Thus Gauss formula for n = 2 is 


J fdas = fl-1N3) + fu v8) (6) 
which gives the correct value of the integral of f(x) in the range (- 1, 1) 
for any function up to third order. Equation (6) is also known as Gauss- 
Legendre formula. 


Gauss formula for n = 3 is 


foe =§ 7043) s(- 2) +7 8) (7) 


which is exact for polynomials upto degree 5. 


The abscissae xi and the weights wi in (1) are tabulated for different 
values of n. The following table lists the abscissae and weights for values of 


n from 2 to 5. 


TABLE 8.1 Gauss integration: Abscissae and Weights 


N 0, w, 
2 — 0.57735 1.0000 
0.57735 1.0000 
3 — 0.7746 0 0.55555 
0.00000 0.88889 
0.77460 0.55555 
4 — 0.86114 0.34785 
— 0.33998 0.65214 
0.33998 0.65214 
0.86114 0.34785 
5 — 0.90618 0.23693 
— 0.53847 0.47863 
0.00000 0.56889 
0.53847 0.47863 
0.90618 0.23693 


Gauss formula imposes a restriction on the limits of integration to be from 


—Itol. 


b 
In general, the limits of the integral i _ J dx are changed to — 1 to 1 


by means of the transformation 


r= 5(b-Iut sta) 
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EXAMPLE 8.23 
Evaluate (' ec 

using Gauss formula orn=Oandwe3 

Solution: 


(i) Gauss formula for n = 2 is 


1 1 
t= f' “oes s(- s} f(z) where flo)= >> 

_3 

=a" 


1 
(13 1+ TES 


(ii) Gauss formula for n = 3 is 


8 5 3 3 re | 
1=8p0)+3| s-| — ee ere 


Thus I = (1) + 


=15. 


Pas 
4 


EXAMPLE 8.24 


Using the three-point Gaussian quadrature formula, evaluate il 


Solution: 


We first change the limits (0, 1) to — 1 to 1 by (8) above, so that 


1 1 
1-—0O)u-1. +0 u +1). 
c= u5( aout) 
1 
1 dx i a _ du 
o1l+x -lut3 


Gauss-formula for n = 3 is 


ec lf wt 


8(1\_ 5 1 1 
Thus [= ( J+ + 
9\3 apne cal 
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ae = = = 0.29629 + 0.39682 = 0.6931 


27 
Otherwise (using the table): 
T=w, f(u,) + wy f (us) + ws f(u;) where f(u;) = — 
U; 


Using the abscissae and weights corresponding to n = 3 in the above table, 
we obtain 


1 1 1 
=——— (0.555) + —— (0.8889) + sane 
3— 0.7746 3-0 3 +0.7746 


= 0.4497 X 0.5555 + — =. 8889) + 0.2649 x 0.5555 = 0.6931. 


EXAMPLE 8.25 
2x47 +2x4+1 
Evaluate aa by the Gaussian three-point formula. 
ol+ 
Solution: 


a the limits is integration 0 to 2 to — 1 to 1 by 


2-0 2+0 


5(b- a)u+— =(b+a)= dar a 


4 


du [: dx = du] 


2x” +2 +1 =f" (u +1) +2(ut+1)+1 
01+(x+1) -1 1 +(u+1+u)* 


Lui t+4u+4 +4u+4 
ae Meee ec, l(u+2)4 ru ffl flu) 


+4u,+4 
= wf (u,) + wef (ug) + w3 f(u3) where f(u;) =titau td 
(u, +.2)° + 
4 + 
Now {(0)==—~ =a 
IO" 7 


f-( 3 | (-¥B75) +2) __ 15016 _ 9 sory 
[-/(3/5) +2} +1 3.2548 


rE); nieibe. _ 7.6984 See 


3/5) +2]'+1 60.2652 
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Using the three-point Gaussian formula, we have 


I= J) soda =£ 5043 /|[-8) + al 


= (= + 510.4614 + 0.1277] = 0.5365 
gliz7) 9 


Solution: 


Changing the limits of integration (0.2 to 1.5) to (— 1, 1) by 


x=5(b- au+—(b+a)= 


4 


25. 0.2)u+—= 1540.2) 

2 2 

= 0.65u + 0.85 

[= sf. oe“ de=0.65f ¢ ada I f(u)du 


so that f(w) u)= e7(0.65u + 0,85)2 


Nga f0) -[0.65(0) + 0.85]2_ 0.4855, 


f(J375) = f (0.7746) = e710 950.7746)+0.85F — 9 1601. 


Using the Gauss hes formula, we have 
i= J f(ujdu =— f 0) f(-—Y3/5) + f(W375)] 


5 5 
= 5 (0.4855) + = [0.8869 + 0.1601] = 0.4316 + 0.5187 = 1.0133 
1.5 2 
Hence f jo) d= 0.65(1.0133) = 0.65865. 


Exercises 8.3 


1. Obtain an estimate of the number of sub-intervals that should be cho- 
sen so as to guarantee that the error committed in evaluating f ” dx/x by 
i : 1 
trapezoidal rule is less than 0.001. 


2. Evaluate f 5 < using the Romberg’s method. Hence obtain an ap- 
Ox +4 


proximate value of z. 


10. 


11. 
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. Apply Romberg’s method to evaluate i, “logs dx, given that 


x: 4.0 4.2 4.4 4.6 4.8 5.0 5.2 
log x: | 1.3863 | 1.4351 | 1.4816 | 1.526 | 1.5686 | 1.6094 | 1.6486. 


/2 
. Using the Euler-Maclaurin formula, find the value of f 7 sinx dx Cor- 


rect to five decimal places. 


. Using the Euler-Maclaurin formula, prove that 


n 


7 n 1 2 
ie ye = aires (b) ye = 4 


r T 
. Apply the Euler-Maclaurin formula, to evaluate 
1 1 1 1 
(a) —~+—— +—— +--+ 
400 402 404 500 
1 1 1 1 
(b) 


+ =+ >t...+ 5 
(201) (203) = (205)" (299)” 


h ; ; 
. Assuming that f ; y(x)dx =h(apyy + a,y,) +h? (boyy +b,y; ) derive the 


quadrature formula, using the method of undetermined coefficients. 


. Using the Gaussian two-point formula compute 


2 


(a) feds ) Yas = POO 


1 


. Using three point Gaussian quadrature formula, evaluate: 


(a) () fax (b) [° sax 
2x Lids 


Evaluate the following, integrals, using the Gauss three-point formula: 
4 7 4 . 
@ fora WG 


1 
Using the four point Gauss formula, compute f ; xdx correct to four 
decimal places. 
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8.11 Numerical Double Integration 


The double integral 
=f" ff" flepdrdy 


is evaluated numerically by two successive integrations in x and y directions 
considering one variable at a time. Repeated application of trapezoidal rule 
(or Simpson’s rule) yields formulae for evaluating I. 


Trapezoidal rule. Dividing the interval (a, b) into n equal sub-intervals 
each of length h and the interval (c, d) into m equal sub-intervals each of 
length k, we have: 


x,=x,t+ih,x,=a,x, =b. 
Y, = Yo + jk, Yo =C, Yn > d. 
Using trapezoidal rule in both directions, we get 


T= ffl) + flint )+2{ flxy.y) + flrs,y) +... + fx, y)}ldy 


hk 
= 7 {foo + fom) F 2 fou + fos +... fg, — 1) 


HO Tn) toe ae eee 1) 


n—-1 


+2 {(fo + fin) + 2fn + fig +--+ fiom} 
i=l 


where f, = fix, y,)- 
Simpson’s rule. We divide the interval (a, b) into 2n equal sub-intervals 
each of length h and the interval (c, d) into 2m equal sub-intervals each of 
length k. Then applying Simpson’s rule in both directions, we get 
Yirt (Xin h Y irl 
SJ Feswbasdy =f" fy) + 4 flo) + fein wldy 


3 Yj 
hk ; 
=a Lier F Afi jt fi Loft i A(fisj-1 +4f;j + fijar) 


9 
+ fist ja t4 fia it fiat jo 
Adding all such intervals, we obtain the value of I. 
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EXAMPLE 8.27 


led 
Using trapezoidal rule, evaluate I = f ie ge 


oo four sub-inter- 
vals. 


Solution: 
Taking h = k = 0.25 so that m =n = 4, we obtain 


1 
[= Prey a faa) ete 2( fir.1.95) + f(1,1.5) + f.7s)) 


+ fiar) + flaa) + 2(fiar95) + flarsy + f(2,1.75) 


+2 for951) + firas2) +26 951.95) +A C2515) +fi251.75)) 
+ firsay + firs) +2(fi51.25) + fsis) + fsizs)) 


+ fiz.) + faz.) + 2( fr75,1.95) as far.) ct fams..75))}] 
= 0.3407 


EXAMPLE 8.28 


Apply Simpson’s rule to evaluate the integral 


2.6 p44 dxd 
SS 


Solution: 


Taking h = 0.2 and k = 0.3 so that m = n = 2, we get 


[= m1 fl4.2) )+4f(4,2.3) + f(4,2.6) 


+4{ f(4.2,2) +4 f(4.2,2.3) + f(4.2,2.6)} 
+f(44,2) +4 f(4.4,2.3) + f(4.4,2.6)] 


a ae [0.6559 + 4(0.6246) + 0.5962] 


-—= X 3.7505 = 0.025 


Exercises 8.4 


1. Evaluate f : i, : xedxdy using the Trapezoidal rule (h =k = 0.5). 
2. Apply the Trapezoidal rule to evaluate 


(a) f, oe Rare taking two sub-intervals. 
24 
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b) f° f as taking h =k = 0.25. 
o41 (1+? yy 


3. Evaluate f : i, : f (x,y)dxdy the Trapezoidal rule for the following data: 
0oY0 


y/x 0 0.5 1 1.5 2 
0 2 4 5 5 
i 3 6 9 11 
2 4 6 8 11 14 


4. Using the Trapezoidal and Simpson’s rules, evaluate 
lel vs, 
ii ‘ i : e*dxdy taking two sub-intervals. 


5. Using Simpson’s rule, evaluate 


28 p32 dxdy wo Sof dxdy 
(a) J, J, x+y 0 Ol+tx+y taking h =k = 0.5. 


8.12 Objective Type of Questions 


Exercises 8.5 
Select the correct answer or fill up the blanks in the following questions: 


1. The value of 1 de ——— by Simpson’s rule is 
Ol+x 


(a) 0.96315 (b) 0.63915 
(c) 0.69315 (d) 0.69351. 
2. Using forward differences, the formula for f(a) =....... ; 


3. In application of Simpson’s 1/3rd rule, the interval h for closer approxi- 
mation should be ...... : 


4. f(x) is given by 
X 0 0.5 1 
fx): 1 0.8 0.5 


then using Trapezoidal rule, the value of f : filaidect8..i0s.:s 
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then the value of f : f (x)dx by Simpson’s 1/3rd rule is .... . 
) 


6. Simpson’s 3/8 rule states that ..... . 
7. For the data: 


t: 3 6 9 12 
y(t): = i 2 3 


the value of f . y(t)dt when computed by Simpson’s 1/3 rule is 
(a) 15 (b) 10 (c) 0 (d) 5. 


8. While evaluating a definite integral by Trapezoidal rule, the accuracy 
can be increased by taking ..... . 


1 - 
9. The value of i. : So by Simpson’s 1/3 rule (taking n = 1/4) is ..... : 
x 


10. For the data: 


Xi 2 4 6 8 
Ff (x): 3 5 6 7, 
i, : f(x)dx when found by the Trapezoidal rule is 
(a) 18 (b) 25 (c) 16 (d) 32. 


11. Given fi, for tootiot vt ix ton top too: then the Trapezoidal rule for evalu- 
ating [= f ss if = f (x, y)dxdy is 
Xo Yo 


12. Gaussian two-point quadrature formula states that ....... . 


dy 
13. The expression for (=!) using backward differences is ..... ; 


14. The number of strips required in Weddle’s rule is ...... . 


15. The error involved in Simpson’s 1/3 rule is 


3 5 5 vi 
-SPO O-LFH @- pw @- pw 


a) ~ 80 345 


396 ° 


16. 
17. 


18. 


19. 
20. 


21. 


22. 


23. 


24. 


25. 
26. 
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The expression for Romberg integration is I = ...... 


The number of strips required in Simpson’s 3/8 rule is a multiple of 
(a) 1 (b) 2 (c)3 (d) 6. 


Add two terms to the Euler—Maclaurin formula 
Xo tnh h 
1: yd = (yo +24) + 24. +... 4 24,4 +Yn)—--- 


By the Gauss three-point formula, { ‘ f(x)dx = 


The order of error in the Trapezoidal rule and Simpson’s 1/3 rule is ..... 
and ....., respectively 


16 4 16 1 l 
If y=Ly= 17 Yo = 5 Y3 = 9574 = 9 and h= q then using the Trap- 


4 
idal rul ie 

ezoidal ru ef. ydx =... 

The total error E in Trapezoidal rule = ...... : 


Using Simpson’s 1/3 rule, se =.,.(taking n = 4) 
Ify,=1 y,=0.5, y, =0.2, y, =6.1, y, = 9.06, y, = 0.04 and y,= 0.03, then 


6 


ydx 
by Simpson’s 3/8 rule = ....... 


If f (0) = 1, f (1) =2.7, f (2) =7.4, f (3) = 20.1, f (4) = 54.6 and h = 1, then 


0 


f : f(x)dx by Simpson’s 1/3 rule = ..... é 
Simpson’s 1/3 rule and direct integration give the same result if ...... ; 


Whenever the Trapezoidal rule is applicable, Simpson’s 1/3 rule can also 
be applied. (True or False) 


CHAPTER 


DIFFERENCE EQUATIONS 


Chapter Objectives 


e Introduction 


e Definitions 


e Formation of difference equations 


e Linear difference equations 


e Rules for finding the complementary function 


e Rules for finding the particular integral 


e Difference equations reducible to linear form 


e Simultaneous difference equations with constant coefficients 


e Application to deflection of a loaded string 


e Objective type of questions 


9.1 


Introduction 


Difference calculus also forms the basis of Difference equa- 
tions. These equations arise in all situations in which sequential re- 
lation exists at various discrete values of the independent variable. 
The need to work with discrete functions arises because there are 
physical phenomena which are inherently of a discrete nature. In 
control engineering, it often happens that the input is in the form of 
discrete pulses of short duration. The radar tracking devices receive 
such discrete pulses from the target which is being tracked. As such 
difference equations arise in the study of electrical networks, in the 
theory of probability, in statistical problems, and many other fields. 
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Just as the subject of Differential equations grew out of Differential 
calculus to become one of the most powerful instruments in the hands of a 
practical mathematician when dealing with continuous processes in nature, 
so the subject of Difference equations is forcing its way to the forefront for 
the treatment of discrete processes. Thus the difference equations may be 
thought of as the discrete counterparts of the differential equations. 


9.2 Definition 


A difference equation is a relation between the differences of an un- 
known function at one or more general values of the argument. 


Thus AY (41) - y(n) =2 (1) 
and Ay j=l (2) 


are difference equations. 


2 
(n+1) + A Yu 


An alternative way of writing a difference equation is as under: 


Since Ay (41) = Yinaz) — Viney therefore (1) may be written as 


Y in42) = y(,.1) + Yin) =2 (3) 


Also since, A’y i Vinay ~ ey Van therefore (2) takes the form: 


(nt1 

Y (n49) -_ 2Y + Y nt) =i (4) 

Quite often, difference equations are met under the name of recur- 
rence relations. 


Order of a difference equation is the difference between the largest and 
the smallest arguments occurring in the difference equation divided by the 
unit of increment. 
Thus (3) above is of the second order, for 
largest argument smallest argument _ (n+2)—n 


. . = 2, 
unit of increment 1 


(n+2)—(n—1) 
1 
NOTE Obs. While finding the order of a difference equation, it must 
——— always be expressed in a form free of As, for the highest power 

of A does not give order of the difference equation. 


and (4) is of the third order, for =3, 
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Solution of a difference equation is an expression for y(n) which satisfies 
the given difference equation. 
The general solution of a difference equation is that in which the num- 
ber of arbitrary constants is equal to the order of the difference equation. 
A particular solution (or particular integral) is that solution which is 
obtained from the general solution by giving particular values to the con- 
stants. 


9.3 Formation of Difference Equations 


The following examples illustrate the way in which difference equations 
arise and are formed. 


EXAMPLE 9.1 


Form the difference equation corresponding to the family of curves 


(1) y = ax + bx? (2) y, =a sin nO + b cos nO (i) 
Solution: 
(i) We have Ay = a A(x) + bA(x?) =a (x + 1-x) + b[(x + 1)? -x?] 
=a+b(2x +1) (ii) 
and A*’y = 2b[(x + 1) -x] = 2b (iti) 


9 


To eliminate a and b, we have from (iii), b = 5A y 
and from (ii), g= Ay — b(2x + 1) = Ay — <A?y(2x +1) 
Substituting these values of a and 7 (i), we get 
y =[Ay- 5 Ay 2x +1)x+ = Ady. 
or (x? + x)A*y — 2xAy +2y =0 


This is the desired difference equation which may equally well be writ- 
ten in terms of E as 


(x? +x)y,. — (2x? + 4x)y 1 + (x? + 3x + 2)y =0 
(ii) y, =a sin nO + b cos nO 
y,, ,=a@sin (n+ 1)6+b cos (n+1) 0 
and Y,,,=4@sin(n + 2)0+b cos (n + 2)0 
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+y, =alsin (n + 2) 6 + sin nO] + bi cos (n + 2) 0 + cos nO] 
= 2a sin (n + 1) A cos 0+ 2b cos (n+ 1) 6 cos 8 
= 2cos 6 [a sin (n + 1) 0 +b cos (n + 1) 6] 
= 2 cos 8 (yn + 1) 


Thus 1 


In+2 


Hence 1 —21 cosO0+y =0. 
nea Yat Y,, 


EXAMPLE 9.2 
From y, = A2" + B(- 3)", derive a difference equation by eliminating 
the constants. 


Solution: 

We have y, = A.2" + B(-3)", y, 1 = 24.2" — 3B(- 3)" 
and Y 9 = 4A.2" + 9B(- 3)”. 

Eliminating A and B, we get 


y, 1 1 
Yn4+1 2 —3 = 0 or Ynss 5 Yat ~ by, = 0 
Yn+2 cs 9 


which is the desired difference equation. 


EXAMPLE 9.3 
Show that n circles drawn in a plane so that each circle intersects all the 
others and no three circles meet in a point, divide the plane into n?-n + 2 
parts. 
Solution: 


Let y, denote the number of subregions into which the entire plane is 
divided by n circles. When (n + 1)" circle is drawn to intersect each of the 
previous n circles, 2n more subregions are added to y, subregions. 


ie. ed Yn +1 oa Y, + 2n 
. The diffference equation satisfied by y, is 
Y,.17Y,=2n ie, A =2[n]! 


yn 
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y, =2A'[n] =e Tema re 


Obviously when n = 1, y, = 2 
Putting n = 1 in (i), we get 2=1 (1-1) +ci.e., c=2. 
Hence y, = n(n — 1) + 2. 


Exercises 9.1 


4. 


9.4 


. Assuming 


. Write the difference equation A*yx + A’yx + Ay, + y, = 0 in the subscript 


notation. 
log(1 —z) 


1+z 
equations satisfied by y,. 


) 
= yy tyyztyox +...4+y,2" ..., find the difference 


. Form a difference equation by eliminating arbitrary constant from 


u, ~~ qentt, 


Find the difference equation satisfied by 


(i)y=axt+b  (ii)y=ax?—bx. (iti) y, =(V2)" asin" + boos 


. Derive the difference equations in each of the following cases: 


(i) y, =A.3" + B.5". (ii) y,, = (A + Bx)2*. 


. Form the difference equations generated by 


(i) yx = ax + bx (ii) y, = a2" + b(- 2)" 
(iii) yx = a2* + b3* +c. 


. Show that n straight lines, no two of which are parallel and no three of 


1. 
which meet in a point, divide the plane into ra +n+2) parts. 


Linear Difference Equations 


Def. A linear difference equation is that in which y, ,,, y,,.. etc. occur to 
the first degree only and are not multiplied together. 


A linear difference equation with constant coefficients is of the 


form 


Y nae + “Yr + OY og sp ay, =f(n) (1) 
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where d,, d,, *** , @, are constants. 


Now we shall deal with linear difference equations with constant coef- 
ficients only. Their properties are analogous to those of linear differential 
equations with constant co-efficients. 


Elementary properties. If u,(n), u,(n), --- , u,(n) are r independent solu- 
tions of the equation 


Ye + 7 Oe ay, = 0 (2) 
then its complete solution is U, = c,u,(n) + c,u,(n) +--+ cu (n) 
where ¢,, ¢,, -*- , ¢, are arbitrary constants. 


If V_ is a particular solution of (1), then the complete solution of (1) is 
Y, = U + Vs 


The part Un is called the complementary function (C.F.) and the 
part V_ is called the particular integral (P.I.) of (1). 


Thus the complete solution (C.S.) of (1) is yn = C.F. + P.I. 


9.5 Rules for Finding the Complementary Function 


(i.e., rules to solve a linear difference equation with constant coefficients 
having right hand side zero) 


A 


n+l yn ~ 2 


1. To begin with, consider the first order linear equation y 
where A is a constant. 


Yntt _ Yn _ 0, we have a( | =0, which gives y /A, = 


Rewriting it as 
c, a constant. 


Thus the solution of (E—/) y, =Oisy, =e.A". 


Ant A nn 


n n 


2. Now consider the second order linear equation y, ,, + ay,,, + by, =0 
which in symbolic form is 
(E>+aE+b)y =0 (1) 
Its symbolic co-efficient equated to zero i.e., E27 + aE +b =0 
is called the auxiliary equation. Let its roots be 4,, A,. 
Case I. If these roots are real and distinct, then (1) is equivalent to 
(E-J )(E-A,)y, =0 (2) 
or (E-A,)(E-A,)y, =0 (3) 


DIFFERENCE Equations ° 403 


If y, satisfies the subsidiary equation (E — A,)y, = 0, then it will also 
satisfy (3). 


Similarly, ify, satisfies the subsidiary equation (E —A,)y, = 0, then it will 
also satisfy (2). 


*. It follows that we can derive two independent solutions of (1), by 
solving the two subsidiary equations 
(E-A, jy, =0 and (E-A,)y, = 
Their solutions are respectively, y, =c,(A,)" io y, =¢,(A,)" 
where c,, c, are arbitrary constants. 


Thus the general solution of (1) is y, =c,A,)n + ¢,(A,)n. 


Case II. If the roots are real and equal (i.e.,4, =A,), then (2) becomes 


(E-A,)¥y, =0 (4) 
Let Y, = (A,)"Z,, 
where z, is a new dependent variable. Then (4) takes the form 
CF ae i 1A) Sey +,°. : (A We n 
or Zaug — 2p, +%, =0 ie., Az =0. 


Z,=0,+¢,n, where c,, c, are oe constants. 


Thus the solution of (1) becomes y, = (c, + ¢,n)(A,)n. 


Case III. If the roots are imaginary, (i.e. 1, =a + iB, A, =a — if), then 
the solution of (1) 
is y, =c,(a + iB)" + c,(a - ip)" [Put @=rcos 6 and 6 =r sin 6] 
=r [c,(cos n@ +i sin nO) +c, (cos nO —i sin n@)] 
=r"[A, cos né + A, sin nO] 
where A,, A, are arbitrary constants and r= (a? + 6’), 0=tan'(B/a). 


(3) In general, to solve the equation y,,.+ ay,,,.,+4@2y,,.5t + ay, = 
0 where a’s are constants: 


(i) Write the equation in the symbolic form (E' +alE™'+--+a)y,=0. 


(ii) Write down the auxiliary equation i.e., E" + alE™' -.. +a,=0 and 
solve it for E. 
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(iii) Write the solution as follows: 


S.No. Roots of A.E. Solution, i.e. C.F. 
1. A,,4,,4,,--(veal and distinct roots) c,h + ofA)" #04.) 
2. [A,,A,,A,,---(2 real and equal roots) (ec, +on)(A,)* + 0,(4,)* +> 
3. [4,,4,,4,,---(3 real and equal roots) (c, ten +en,)(y,)" + 
4. |a+iB,a—if, -- (apair ofimaginary |r°(c, cos nO + c, sin n@) 
roots) where r = V(a? + B?) 
and @ = tan"! (B/a). 
EXAMPLE 9.4 
Solve the difference equation u,,-2u,,-—5u,,, + 6u, =0. 
Solution: 
Given equation in symbolic form is (E° — 2E* — 5E + 6)u, =0 
.. Its auxiliary equation is E® — 2E? -5E+6=0 
or (E-1)(F + 2)(E-3)=0. “. E=1,-2,3. 
Thus the complete solution is u, =c,(1)" + ¢,(— 2)" +¢,(3)". 
EXAMPLE 9.5 
Solveu,,-2u,,+u,=0. 
Solution: 
Given difference equation in symbolic form is (E° — 2E + 1)u, = 0. 
. Its auxiliary equation is E?- 2E + 1 =0 
or (E-1)?=0. b= 1,1 
Thus the required solution is un = (c, + c,n)(1)",i.e., u, =e, ten. 
EXAMPLE 9.6 
Solve y,,-2y, cosaty, ,=0. 
Solution: 
This is a second order difference equation in y, ,; which in symbolic 
form is 


(E°-2E cosa+1)y, =0. 


DIFFERENCE Equations ° 405 


The auxiliary equation is E? - 2E cosa@+1=0 
ie 2cosa+(4cos” a@—4) 


ri =cosa@tisina. 
Thus, the solution is y,_, =(1)""[el1 cos (n- 1) @ +c, sin (n — 1)a] 


or y, =C, cosna@ +c, sin na. 
Jn 1 2 


EXAMPLE 9.7 


The integers 0, 1, 1, 2, 3, 5, 8, 13, 21,--- are said to form a Fibonacci 
sequence. Form the Fibonacci difference equation and solve it. 


Solution: 


In this sequence, each number beyond the second, is the sum of its two 
previous numbers. If y, be the nth number theny =y, ,+y,, forn > 2. 


a Ying ~ Yat ~ Y,, = 0 (for n> 0) 
or (E° — E -1)y, = 0 is the difference equation. 


1 
Its A.E. is E?— E— 1 =0 which gives E= gt +,/5). 


1+5)" 1-5)" 
Thus the solution is y,, = | =| +c, =") ,forn > 0 


When n = 1, y, =0 
o (28) +0,[ 28 )<0 (i) 


2 


When n = 2, y, =1 
a (42-0, (2 25) =] (ii) 


2 


Solving (i) and (ii), we get 


Hence the complete solution is 


oe) 
2 


In ~~ F69 2 10 
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Exercises 9.2 


Solve the following difference equations: 


1. Uy — 4U,4, +4U, =0, given u, = 1,u, = 0. 

2. Yara FYna + 2y, = 0. 

3. A?u, +2Au, +u, =0. 

4. (A* -3A +2)y, =0 

5. 4y —y,,, =0 given that y, =0, y, =2. 

6. U,,5— 3,45 + 4u, = 9. 

7. fix+3)-3f(x+1)-2flx) =0. 

8.u,3-3, 142, =0, givenul =0,u, =8 andu, =—-2. 

9. (E°-5E? + 8E —4)y, =0, given that y, =3, y, = 2, y, = 22. 
10.u,,,—2u,+2u -1=0. 


=— 
—_ 


12. 


13. 


14. 


15. 


-y, 3+ 16, -1=0. 


ym 


[HINT. E* =— 16 = 16 [cos (2n + 1) +i sin (2n + 1)z]; use De Moivre’s 
theorem. | 


Show that the difference equation I, —(2+1,/r) I,, +I, =0 has the 


solution I, = I, sinh (n —m)a/sinh (n - 1)a, if 1=I, and I, = 0, a being = 
1 
2 sinh” 5(% fry? 


A series of values of yn satisfy the relation y,,, + Gi by, = 0. Given 
that y, =0, y, = 1, y, =y, = 2. Show that y, = 2"? sin nz1/4. 


A particle is moving in a horizontal direction. In each second, it travels 
a distance which is twice the distance moved in the previous second. If 
the distance moved in the rth second is x, and x, = 3, x, = 4, then show 
that x, =2"+ 2. 


A plant is such that each of its seeds when one year old produces eight- 
fold and produces eighteen-fold when two years old or more. A seed is 
planted and as soon as a new seed is produced it is planted. Taking y, to 
be the number of seeds produced at the end of the nth year, show that 
Ye = Sy, + 18 (y, Tg Fer Ua: 

Hence show that y,, — 9y,,, — 10y, = 0 and find y, . 
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9.6 Rules for Finding the Particular Integral 


Consider the equation y,,+a,y,,., +-+ay, =fin) 


which in symbolic form is P(E), =f(n) (1) 

where P(E) = E"+ 4,E"™' +... +4. 

Then the particular integral is given by P.I= a f(n) 

Case I. When f(n) =a" (Power function) 

PI a. tk 
.=— a", putE=a 
gE)? 
1 
= —a" provided (a) ¥ 0. 
ga Pee 
If p(a) = 0, then for the equation 
(i) (i= ) a iM PI= 1 Nea n-1 
1 ayy, =a f. ~ Fan" =na 
. P _ 1 n  Wn-1) ,- 
(ii) (E-a)’y, =a nr a = oT 2 
1 -—l)\(n-2 

(iii) (E -_ ay y" =," PI= ze = > gh n(n “ ) rs 

and so on. 
EXAMPLE 9.8 

Solve Y nto i AY ale 3Y, = 5”, 

Solution: 

Given equation in symbolic form is (E° — 4E + 3)y, =5" 

. The auxiliary equation is E* - 4E + 3 = 0 
or (E —1)(E—3) =0 “HE 1,3 

-. C.F. =e,(1), +6,(3)" =e, +,.3" 
and SS [Put E = 5] 

EY -4E4+3 
1 1 


n 


95-4543 8 
Thus the complete solution is y, = cl + ¢,.3" +5". 
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EXAMPLE 9.9 


Solveu.,—4u,+4u. = 2n. 
n+ n+] n 


2 


Solution: 


Given equation in symbolic form is (E? — 4E + 4)u, = 2n. 


The auxiliary equation is E?- 4E + 4=0. w EB =2,2. 
C.F. = (c, + cn)" 
1 -l ‘ 
PI= 9 = MOD) on 8 - nin as. 
(E—2) 2! 


Hence the complete solution is u, = (cl + ¢2n) 2” + n(n — 1) 2°. 


Case II. (1) When f(n) = sin kn. (trigonometric function) 


1 Ljetae™)_ 10-0 «bs 
P= inkn= ao a Jeo 36" 
where a = e* andb =e*. 
Now proceed as in case I. 
(2) When f(n) =cos kn 


1 ikn a —ikn 
P.I.=—~coskn = (: | 
) 2 


P(E) GE 


1 1 n 1 n 
-i ee wer Jashetore 


Now proceed as in case I 


EXAMPLE 9.10 
Solve y,,—2cos ay, ,, +y, = Cos an. 
Solution: 
Given equation in symbolic form is (E? — 2 cos a. E+ 1) y, = cos an 
The auxiliary equation is E?-2cosa.E+1=0. 
_ 2cosa+ (4cos” a—4) 
2 
C.F. = (1)n [c, cos an +c, sin an], i.e., c, cos an +c, sin an. 


=cosaxtisina. 
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1 
PlJ= 7 cosan 
EX -—2Ecosat+l1 
a l ( + ) 
E? — E(e* +e) +1 2 
1 1 ian 1 ian 
2| (E—e")\(E-e ”) (E—e)(E-—e*) 
[Put E = e'“] [Put E = e7'7] 


= i 1 ei _ I al 
4isinaLE—e' E-e 


= 1 In : giatn-}) —n-: er) 
Aisina 

on eiein-l) — pian} a nsin(n _ De 
2sina Qi 2sina 


Hence the complete solution is 


nsin(n — 1) 
Y, = C, cosan + cy sinan + ———_ . 
2sina 
Case IIL. When fin) = np. (Polynomial function) 
1 1 
P.I[=——n’ = nP 


P(E) p(l + A) 


1. Expand [@(1 + A)]"' in ascending powers of A by the binomial theorem 
as far as the term in Ap. 


2. Express n? in the factorial form and operate on it with each term of the 
expansion. 


EXAMPLE 9.11 


Solve y,,,-4y, = +n-1. 


Solution: Given equation is (E*- 4)y, =n? +n-1. 


The auxiliary equation is E7-4=0, «. E= + 2. 


410 © Numerical METHODS IN ENGINEERING AND SCIENCE 


Pl= -))= 1)+2 
ae (n> +n—-1) d+ap—4_ (n—1)+2n-1] 
1 : A?\) 
= apoaae | +In]-l=- | A+ ; ] {In}? + 2[n]-1} 
1 2 Py tees ak 4 
-t)ra[Jas | [Eas 4 + pet + 2[n]—1} 
1 (a5 9 
=a +...]{{nF + 2[n]-1} 
— 2 7 47 
=——{[n} +2[n] 17 (Q2[n]+2+ on oF 
Hence the complete solution i =c,2" + a ee 
p ition is y, =c, os ar ec. 
Case IV. When f(n) =a" F(n), F(n) being a polynomial of finite degree 
inn. 
NE/p\— nr. 1 
aa F(n)=a Bak) F(n). 


Now F(n) being a polynomial in n, proceed as in case HI. 


EXAMPLE 9.12 
Solve y,,- 2y,,,+y, =1.2". 
Solution: 
Given equation is (E? — 2E + l)y, =n?.2n. 
Its C.F.=c,+ce,n 
i 2 
z2n =5 zn =2 EL 
(E-1) (2E—-1) (1+2A) 
2" (1+ 2A)" {n(n —1) +n} = 2" (1—4A + 12A? —---)([nP +[n] 
= 2"{[n}P +[n]—4(2[n]+ 1) +12 x2} 
2"([n i —7[n]+ 20) = 2"(n? —8n + 20). 


gn 2 n 1 2 on 


Hence the complete solution is y, =c, + cn + 2"(n? — 8n + 20). 
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Exercises 9.3 


Solve the following difference equations: 


1.y,..-9y,,, — Sy, =4,,y,=9,y, = 1. 
Yt 6y,,, + 9, =2,,y,=y, =9. 

= Yoi3— 8Y pia + SY, — YP = I. 

. (E?— 4E + 3)y = 3x. 

-U,,.— Tu,,, + 10ux = 12.4x. 

© Yosg — 4Y eu, + 4yx = 3.2% + 5.4x. 


xt2 


NO wn BP WN 


u_,—-u =cosn/2. 
Vth n 


. 


1 
8. y_,. — (2 cos . Ya ty, = sin p/2. 


9.y ,-2y,,,+4y, =6, given that y, =0 and y, = 2. 
10. (E?-4)y =x?-1. 

ey ,ty =nt+ly0=y, =y,=0. 

12.y ,,-5y,,,+ 3y,,, + 9y, =2" + 3n. 

13. (4E°-4E +1) y=2"+2". 

14.y ,+5y,,,+ 6y, =n t+ 2". 

15.u,,, + 6u_,, + 9u,=x2" + 3x +7. 

16. y,,, + 8yn = (2n + 3) Qn. 


17.u,,,—4u,,, + 4un = n°2n. 


18. (E?-5E +6) y, =4k(k?-k +5). 


19. (EF? -2E +4)y, =-2" |Scos" + 2yBsin =) 
20. A beam of length /, supported at n points carries a uniform load w per 
unit length The bending moments M,, M,... M, at the supports satisfy 
the Clapeyron’s equation: i 
M4. +4M,,, +M, = aout 


4 
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21. If a beam weighing 30 kg is supported at its ends and at two other sup- 
ports dividing the beam into three equal parts of 1 meter length, show 
that the bending moment at each of the two middle supports is 1 kg 
meter. 


9.7 Difference Equations Reducible to Linear Form 


At times non-linear difference equations can be reduced to the linear 
form by a suitable substitution. We shall consider the following types of 
such equations: 


I. Homogeneous equation of the type F{y,,,/y,, } = 9. 


Putting y,, /y, =u, this equation takes the linear form F(u,, x) = 0. 


EXAMPLE 9.13 
Solve y_,,” — 3y,,, y, + 2yx? = 0. 
Solution: ;: 
Dividing throughout by y,”, it becomes (22 = o( | +2=0 
Putting y_,,/y,=u,, we getu>-3u,+2=0 
or Case I. When ux = li.e., Yiu) — YX = 9. 
Its AE. isE-1l=OorE=1. 
. Solution is y, =c,.(1)x =c,. 
Case II. When u, = 2i.e., y,,, — 2yx = 0. 
Its A.E.isE-2=OorE=2. 
Solution is y, = c,(2)*. 
I. Equation of the type p(x) y.y,., + 9a)y,,, + rx)y, = 0 
ye 
Yo Yet 
Putting l/y, =wu,, we get p(x) + q(x) u, + r(x) u,,, =0 


xt] 


Dividing throughout by y, y,,,, it reduces to p(x =0 


which is a linear equation. 


DIFFERENCE EQUATIONS ° 413 


EXAMPLE 9.14 
Solve y,..,-y, + XY,,,Y, = 9 given y, =2. 
Solution: 


Dividing throughout by yy,,,, the given equation becomes 


1 1 
sey 

Yrtt Ux 1 
Putting l/y, =u,, we getu,,, —u,=x where u, = o Su 2. 
or Au, =x oru, =A™'[x]=[xP /2+¢, 
But u, = 1/2. 0, = We. 

1 1 1 2 
Thus u, =—x(x-I)+— ie. y, =—=5 
~ 2 2 the” See 


UI. Equation of the type y.y,,, + p(x) y,,,+ q(x) y, = r(x). 


x+1 
We have y,,, ly, + p(x)] + q(x) y, = r(x) (1) 
Putting y, + p(x) =u,, /u, or y, = (u,,,A,) — p(x), (1) reduces to 

| — plx + pe + q(x) [2 - | = r(x) 


Uy41 *. 
or uo + [q(x) — p(x + 1)Ju,,, — p(x) g(x) + r(x) Ju, = 0 


which is a linear equation. 


EXAMPLE 9.15 
Solve yy, + (x +2)y.., txy, +x? +2x+2=0. 
Solution: 


We have y_,, [y,+ x + 2] +xy,=—x°- 2x -2 


xt] [ 


Putting y, = stl (x + 2), 
u 


x 


it reduces to “#2. =—9 or tive — Stl, 4, +2u, =0. 
Uy 
Its A.E. is E?-3E +2=0, . E=1,2. 


Thus the solution is u,=c, + c, 2". 
,=a2" 


= ge ee 
Cy +652 


Hence the solution of the given equation is y, = 
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Exercises 9.4 


Solve the following difference equations: 


1 7 x Yiso = Page 
2 Yass Ye = a ify, a 1, Ya= 2. 
3. 2y 41° Bs Yu YX — yx” =0. 


4. Ynt+1 — noo Yn = 
5. Y, Yer — 3Y, +2 =0. 
6. You Y, + Yes a Y, +9=0. 


9.8 Simultaneous Difference Equations 
with Constant Coefficients 


The method used for solving simultaneous differential equations with 
constant coefficients also applies to simultaneous difference equations with 
constant coefficients. The following example illustrates the technique. 


EXAMPLE 9.16 
Solve the simultaneous difference equations 
t= 3u, =x, 3u,+0_,- 5, =4 
subject to the conditions w, = 2, v, = 0. 
Solution: 


Given equations in symbolic form, are 


(E-3)u,+v0,=x (i) 
3u, + (E-5)v,=4" (ii) 
Operating the first equation with E —5 and subtracting the second from 


it, we get 


)-3]u, = (E-5)x - 4" 
or (E?-8E + 12)u =1—4x-4" 
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Its solution is 
F 4 19 4 
u, =¢,2* +0,6* ->x-—+— 
: 5 25 4 


Substituting the value of wu, from (iii) in (i), we get 


: bx 34 4° 
), = 0,2" — 30,6" -— - = - — 
qe ae oe 
Taking wu, = 2, v, = 0, in (iii) and (iv), we obtain 
64 74 
2c, + 6c, = 3572 —18c, = 5 
Where C, =1.33,c, =—0.0167 
Hence u, = 1.332" — 0.01676.6" —0.8x —0.76 +4" | 


v, = 1.33.2" — 0.05.6" —1.36-4*7. 


Exercises 9.5 


Solve the following simultaneous difference equations: 
1. You — 4, = (x at 1), qa = Y. = 2x + 1). 
= 0, Zz Zz 2y | = On 


2. Yy ~ Y, + 22 n+l n 


n+1 n+1 


3.u,,,+n=3u, +20, 0 


n+1 n? “ntl 


n=u_ + 2v, givenu,=0, v, = 3. 


n? 


4.u,,,+0,+w,=lu,+0,,+w,=x,u,+0,+w,,, = 2. 


9.9 Application to Deflection of a Loaded String 


Consider a light string of length / stretched tightly between A and B. 
Let the forces P, be acting at its equispaced points x, (i = 1, 2,...,n — 1) and 
perpendicular to AB resulting in small transverse displacements y, at these 
points (Figure 9.1). Assuming the angle 0, made by the portion between xi 
and xi+1 with the horizontal, to be small, we have 


sin 0. = tan 6,=6, and cos 6, = 1. 
If T is the tension of the string at x,, then T cos 0, = T 
i.e., the tension may be taken as uniform. 
Taking x,,, -x,=h, we have 
Yi, —Y, =h tan 8, =hé, (1) 
Lo aad htan 0. = hé,, (2) 
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Also resolving the forces in equilibrium at (xi, yi) 1 to AB, we get 
T sin 0, -T sin 0-1 + P,=0i.e. T(0,-0-1) + P,=0 (3) 


FIGURE 9.1 


Eliminating 0, and 6-1 from (1), (2) and (3), we obtain 


hp; 
Yer — 24) + Y-1 = (4) 


which is a difference equation and its solution gives the displacements yi. 
To obtain the arbitrary constants in the solution, we take y, = y, = 0 as the 
boundary conditions, since the ends A and B of the string are fixed. 


EXAMPLE 9.17 


A light elastic string stretched between two fixed nails is 120 cm apart, 
carries 11 loads of weight at 5 gm each at equal intervals and the resulting 
tension is 500 gm weight. Show that the sag at the mid-point is 1.8 cm. 


Solution: 

Taking h = 10 cm, P,=5 gm and T = 500 gm weight., 

the above equation (4) becomes y,,, — 2y,+y, , =— 1/10 
1 


Le., Yisg — 2Y 41 ty, = To" 
Its AE. is(E-1?=0 ie, E=1,1.  GF.=c, +o, 
fee 1 
Po -(-2}--3 1 (ijse2 D_.L 
(E-1) 10 10 (E-1) 10. 2 20 


1 ‘ 
Thus the C.S. is y; =c, +i er i*) 
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Since y, = 0, .. c, = 0 


ia 
and y,, =0, -. ar 
. Le 
ence = creeped ja 
4 99'* a9"! 


At the mid-point i = 6, we get y, = 1.8 cm. 


Exercises 9.6 


A light string of length (n + 1)l is stretched between two fixed points with 
a force P. It is loaded with n equal masses m at distances /. If the system 
starts rotating with angular velocity «, find the displacement y, of the ith 
mass. 


9.10 Objective Type of Questions 


Exercises 9.7 


Select the correct answer or fill up the blanks in the following questions: 


1.y, =A 2"+B 3", is the solution of the difference equation --- 

2. The solution of (E — 1)? u, = Ois --- .. 

3. The solution of the difference equation u, , ,—2u,,,-5u,, , + 6u, =0 is 
4. The solution of y, , ,-y, = 2" is---given that y, = 2. 

5. The difference equation y, , ,— 2y, =n given that y, = 2 has y, = --- as its 


solution. 


. The difference equation corresponding to the family of curves y = ax? + 


bx is --- 


7. The particular integral of the equation (E — 2) y= 1. 


The solution of 4y, =y, , 2 such that y, =0, y, =2, is --. 


1, 
. The equation A*u,.4, +5 A'u, =0 is of order -- .. 


. The difference equation satisfied by y =a + b/x is --- . 
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11. The order of the difference equation y, ,,-2y,, ,+y,=Ois-. 
12. The solution ofy, ..- 4y,,,+4y,=O0is--. 
— 6u 


wxt1 


13. The particular integral of u, +9u =3is-. 


+2 


14. The difference equation generated by u, = (a + bn) 3" is +: 


15. Solution of 6y, ,,+5y, ,,—6y, =2" is y, = A(2/3)" + B(- 3/2)" + 2"/28. 
(True or False) 
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10.1. Introduction 


A number of problems in science and technology can be formulated 
into differential equations. The analytical methods of solving differential 
equations are applicable only to a limited class of equations. Quite often 
differential equations appearing in physical problems do not belong to any 
of these familiar types and one is obliged to resort to numerical methods. 
These methods are of even greater importance when we realize that com- 
puting machines are now readily available which reduce numerical work 
considerably. 


Solution of a differential equation. The solution of an ordinary differen- 
tial equation means finding an explicit expression for y in terms of a finite 
number of elementary functions of x. Such a solution of a differential equa- 
tion is known as the closed or finite form of solution. In the absence of such 
a solution, we have recourse to numerical methods of solution. 


Let us consider the first order differential equation 


dy/dx = f(x, y), given y(x,) =y, (1) 
to study the various numerical methods of solving such equations. In most 
of these methods, we replace the differential equation by a difference equa- 
tion and then solve it. These methods yield solutions either as a power se- 
ries in x from which the values of y can be found by direct substitution, or 
a set of values of x and y. The methods of Picard and Taylor series belong 
to the former class of solutions. In these methods, y in (1) is approximated 
by a truncated series, each term of which is a function of x. The information 
about the curve at one point is utilized and the solution is not iterated. As 
such, these are referred to as single-step methods. 


The methods of Euler, Runge-Kutta, Milne, Adams-Bashforth, etc. be- 
long to the latter class of solutions. In these methods, the next point on the 
curve is evaluated in short steps ahead, by performing iterations until suf- 
ficient accuracy is achieved. As such, these methods are called step-by-step 
methods. 


Euler and Runga-Kutta methods are used for computing y over a lim- 
ited range of x- values whereas Milne and Adams methods may be applied 
for finding y over a wider range of x-values. Therefore Milne and Adams 
methods require starting values which are found by Picard’s Taylor series 
or Runge-Kutta methods. 
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Initial and boundary conditions. An ordinary differential equation 
of the nth order is of the form 
F(x,y,dy / dx,d°y/dx”,--+,d" y/dx" )=0 (2) 
Its general solution contains n arbitrary constants and is of the form 
P(X, Y,C1,C95°775C,) =O (3) 


To obtain its particular solution, n conditions must be given so that the 
constants c,, c, ...,¢, can be determined. 


If these conditions are prescribed at one point only (say:x,), then the dif- 
ferential equation together with the conditions constitute an initial value 
problem of the nth order. 


If the conditions are prescribed at two or more points, then the problem 
is termed as boundary value problem. 


In this chapter, we shall first describe methods for solving initial value 
problems and then explain the finite difference method and shooting 
method for solving boundary value problems. 


10.2 Picard’s Method 


dy 
Consider the first order equation a f(x,y) (1) 


It is required to find that particular solution of (1) which assumes the 
value y, when x = x,. Integrating (1) between limits, we get 


f dyX& i f(x,y)dx ory Yo f f (x, y)dx (2) 


This is an integral equation equivalent to (1), for it contains the un- 
known y under the integral sign. 


As a first approximation y, to the solution, we put y = y, in f(x, y) and 
integrate (2), giving 
n=Yyor J fleyodde 
For a second approximation y,, we put y = y, in f(x, y) and integrate 
(2), giving 
yay tf fry de 
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Similarly, a third approximation is 
x 
Y¥3 = Yo +f F(x, Yo )dx 
“0 
Continuing this process, we obtain y,, y., --- y, where 


Yn = Yo + iB F(%,Yn-1 )dx 


Hence this method gives a sequence of approximations y,, y,, Y, °*- 
each giving a better result than the preceding one. 


NOTE. Obs. Picard’s method is of considerable theoretical value, but 
can be applied only to a limited class of equations in which the 
successive integrations can be performed easily. The method can 
be extended to simultaneous equations and equations of higher 
order (See Sections 10.11 and 10.12). 


EXAMPLE 10.1 


Using Picard’s process of successive approximations, obtain a solution 
up to the fifth approximation of the equation dy/dx = y + x, such that 
y = 1 when x =0. Check your answer by finding the exact particular solution. 


Solution: 
(i) We have y=1+ Ji + y)dx 
First approximation. Put y = 1 in y +x, giving 
yy =1+ f° (l+x)dx =1l+x4+x°/2 
Second approximation. Put y = 1+x+4°/2iny +x, giving 
yy = 1+ fo txts? B)de=ltxts? +x°/6 


Third approximation. Put y = 1 +x +2? +2°/6 in y +x, giving 


3 4 
x 24.3 Dy Re 
=1+ fo (ltutx? +x°/6)dx =14+ 2x t+2° ++ 
Y3 Si x+x° + x°/6)dx x+x oi 
Fourth approximation. Put y = y, in y +x, giving 


3. 4 
= oe ee oe ae |e 
wats fifsoces va of x 


ae ee 
“3s 12 120 
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Fifth approximation, Put y = y, in y +x, giving 


x? 4 5 
x x 
5=l+ f litorte? +2454 = |x 1 
ue +f,{ ee Ns ip a) 
x? x4 x? x8 
=lt+x+x°+—+—+—+- 
3. 12 60 720 


(ii) Given equation 


dt 
a2 y=x isa Leibnitzs linear in x 
Ny 


Its, I.F. being e~ the solution is 
ye = ff xe*de re 
=—-xe* — f (ce )dx +c=-xe*-e*+c 


v=o =e 1 
Since y = 1, when x = 0, s6= 2, 


Thus the desired particular solution is 


y =2e* —x-1 (2) 
x2 x4 
Or using the series: e* a) aa de ee 
2! 3) «(Ad 
3 4 95 6 
We get geleeea 4-4-4 ee (3) 
& 3. 12 60 360 


Comparing (1) and (3), it is clear that (1), approximates to the exact 


particular solution (3) upto the term in x’. 


NOTE Obs. At x = 1, the fourth approximation y , = 3.433 and the fifth 
approximation y. = 3.434 whereas the exact value is 3.44. 


EXAMPLE 10.2 
Find the value of y for x = 0.1 by Picard’s method, given that 


WL YT* yay, 


Solution: 


We have y= A Nearer 
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First approximation. Put y = 1 in the integrand, giving 


eo ee a ye 
4, = 1+ on ates 14 f(-1 +o ht 


=1+[-x+ 2log(1 +x) |. =1-—x+ 2log(1+x) 


Second approximation. Put y = 1 — x + 2 log(1 + x) in the integrand, 
giving 
plat Qos xe 
01—x+2log(l+2)+x 


=1+ — = |s 
sf:- ease 


which is very difficult to integrate. 


dx 


Yo =1+ 


Hence we use the first approximation and taking x = 0.1 in (i) we obtain 


y(0.1) = 1—(0.1) + 2 log 1.1 = 0.9828. 


10.3 Taylor’s Series Method 


Consider the first order equation a = f(x,y) (1) 
Av 


Differentiating (1), we have ay a: ee af dy ie. y'=f,+ i f' (2) 
dx” ax ars y dx 
Differentiating this successively, we can get yy” ete. Putting x = x, 
and y = 0, the 


Values of (y’)o,.(y")o.(y”)o can be obtained. Hence the Taylor’s series 


(ee ty) ” (<= io)" 
a Pots 


gives the values of y for every value of x for which (3) converges. 


Y= Yo + (x— xo )y')o + (y'")y +... (3) 


On finding the value y, for x = x, from (3), y” y” etc. can be evaluated 
at x =x, by means of (1), (2) etc. Then y can be expanded about x = x,. In 
this way, the solution can be extended beyond the range of convergence of 
series (3). 
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Obs. This is a single step method and works well so long as 
the successive derivatives can be calculated easily. If (x, y) is 
somewhat complicated and the calculation of higher order 
derivatives becomes tedious, then Taylor’s method cannot 

be used gainfully. This is the main drawback of this method 
and therefore, has little application for computer programs. 
However, it is useful for finding starting values for the 
application of powerful methods like Runga-Kutta, Milne and 
Adams- Bashforth which will be described in the subsequent 
sections. 


NOTE 


EXAMPLE 10.3 


Solve y’ =x + y, y(0) = 1 by Taylor’s series method. Hence find the val- 
ues of y atx = 0.1 and x = 0.2. 


Solution: 


Differentiating successively, we get 


y=xty y'(0) =1 [ y(0) = 1] 
y” =e" y’ y”(0) =9 
y” = y” y’”(0) = 9 
y” = y” y’”(0) _ 2, etc. 
Taylor's series is 
Y = Yo +(x XMY)g + " a (y")o + " ma (yo + 
Here x, = 0, y,=1 
y=1+x(1)+ : (2)+ (x)" (2)+ (x)" (4)... 
pers 2 31 
Thus (0.1) =1+0.1+(0.1) 2, 0.1)" 1) 
a 3! rn 
=1.1103 
4 
and y(0.2)=1+0.2+(0.2)° 0.2)", 0.2)" | 


3 6 
= 1.2427 
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EXAMPLE 10.4 


Find by Taylor's series method, the values of y at x = 0.1 and x = 0.2 to 
five places of decimals from dy/dx = xy — 1, y(0) = 


Solution: 


Differentiating successively, we get 


y =x°y 1, y),=-1 [- (0) = 1] 
y” = Ixy +x°y’, (y”), =0 
yf” = 2y ae 4xy’ + x2y”, (yh =- 2 
y= Gy’ + xy” +x2y””, (y””), =— 6, ete. 
Putting these values in the Taylor’s series, we have 
m142(-1) +0) +e) 4 6) 4 
ae 2 3! 4! 
3. 4 
x” ox 
=1+—x4+—--"= 4... 
3 4 


Hence y(0.1) = 0.90033 and y(0.21) = 0.80227 


EXAMPLE 10.5 


Employ Taylor’s method to obtain approximate value of y at x = 0.2 for 
the differential equation dy/dx = 2y + 3e*, y(0) = 0. Compare the numerical 
solution obtained with the exact solution. 


Solution: 
(a) We have y’ = 2y + 3e*; y’(0) = 2y(0) + 3e° = 3. 


Differentiating successively and substituting x = 0, y = 0 we get 


y” = 2y’ + 3e", y”(0) = 2y’(0) +3 =9 
yl” = 2y”” + Be, y/(0) = 2y"(0) +3 =21 
y’ = 2y”” + 3e*, y'°(0) = 2y’"(0) + 3 = 45 ete. 
Putting these values in the Taylor’s series, we have 
2 3 4 
x m Pi iv 
y(x) = y(O) + xy'(0) + ay O+ aw (0) + ad (0) + 
a eee ee ee 
2 6 24 
92 25,1 4 


= 3x +—17 += x2 +— x 
2 6 8 
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Hence (0.2) = 3(0.2) + 4.5(0.2)° +3.5(0.2)° + 1.875(0.2)* +---=0.8110 () 
d 
(b) Now = —2y =3¢e* is a Leibnitz’s linear in x 
A 
Its LF. being ¢_, , the solution is 
ye" = fi sere dxt+c=-3e"*+cor y=-3e" +ce™ 

Since y = 0 when x = 0, sc=3. 

Thus the exact solution is y = 3(e* - e*) 
When x = 0.2, y = 3(e"4 — e°”) = 0.8112 (ii) 


Comparing (i) and (ii), it is clear that (i) approximates to the exact value 
up to three decimal places 


EXAMPLE 10.6 
Solve by Taylor series method of third order the equation dy = i xy” 
y(0) = 1 for y atx = 0.1, x =0.2 andx = 0.3 dx e 
Solution: 
We have y! =(x° +axy" Je"; y (0)=0 


Differentiating successively and substituting x = 0, y = 1. 


x ? 


y" = (x3 + xy” 


)(-e*) + (3x? + y +x.2yy')e~ 
= (-x° — xy? +3x7 ty? +2xyye*;  y"(0)=1 
y” = (—x° — xy? +3x7 + y” + 2xyy')(-e*) 
+{-3x7 — (y” + x.2y.y') + 6x + 2yy’ 
+2[yy’ +x(y +yy}e* y'"(0)=-2 


Substituting these values in the Taylor’s series, we have 
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1 Weed 

Hence y(0.1)=1 +50.1P — 0.1" = 1.005 
1 9 1 3 

y(0.2)=1+ 3 (0.2) 3 (0.2) =1,017 

y(0.3) =1+ = (0.3)° 303) = 1.036 


EXAMPLE 10.7 


dy 
Solve by Taylor’s series method the equation = log(xy) for y(1.1) 
and y(1.2), given y(1) = 2. * 


Solution: 
We have y’ = log x + log y; y’(1) = log 2 
Differentiating w.r.t., x and substituting x = 1, y = 2, we get 


” 11 ' ” 142] 9 
y=—t+—-y y =1+—log2 
4x y? y 9 08 


m 1 1 ” ‘4 1 ' 
yor at y ty (-2 
xy y 


a 1 1 : 1 5\2 
y =1+3(14 F102] 7 (log2) 
Substituting these values in the Taylor’s series about s = 1, we have 


a 2 a 3 
s a cork “ 7 


y(x) = yl) +(x-Dy + y"(1) +e 


=2+(x- Ilog2-+ 5(x=1) (1+ =1og2) 


2 


1 Joli i 
Pe of peer ee re eed 
6 | 2°4°° +(log2)*| 


on 1 on 1 1 1 ‘ 
1.1) =24+(0.1l)log2 +—— [14+ =log2|+ ——+—log2——(log2 
__ fll) = 2+ O.1)log2 + [1+ 5log2]+—— | -5 + log2.—(log2) 


= 2.036 


02" 1 02)" 1s. 1 ‘ 
y(1.2) =2 +(0.2)log2 +——  |1+—=log2|+ ——+—log2——(log2 
y(1.2) = 2+ (0.2)log2 +—— {1+ >log2|+—— | -— + Zlog2——(log2) 


= 2.081 
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Exercises 10.1 


10. 


. Using Picard’s method, solve dy/dx = — xy with x, = 0, y, = 1 up to the 


third approximation. 


. Employ Picard ’s method to obtain, correct to four places of decimals 


the, solution of the differential equation dy/dx =x? + y? for x = 0.4, given 
that y = 0 when x =0. 


. Obtain Picard’s second approximate solution of the initial value problem 


y’ =x?/(y?+ 1), y(0)=0. 


. Find an approximate value of y when x = 0.1, if dy/dx =x — y? and y = 1 


at x = 0, using 
(a) Picard’s method (b) Taylor’s series. 


. Solve y’=x + y given y(1) =0. Find y(1.1) and y(1.2) by Taylor’s meth- 


od. Compare the result with its exact value. 


. Using Taylor’s series method, compute y(0.2) to three places of deci- 


mals from “ =1—2xy given that y(0) =0. 
x 


. Evaluate y(0.1) correct to six places of decimals by Taylor’s series 


method if y (x) satisfies 
y’=xyt+1,y(0)=1. 


. Solve y’ = y*+x, y(0) = 1 using Taylor’s series method and compute 


y(0.1) and y(0.2). 


. Evaluate y(0.1) correct to four decimal places using Taylor’s series 


methods if dy/dx =x*+ y’, y(0) = 1. 


Using Taylor series method, find y(0.1) correct to three decimal places 
given that dy/dx =e —y’, y(0) = 1 


10.4 Euler’s Method 


d 
Consider the equation 2 =~“ (1) 
AY 


given that y(x,) = y,.Its curve of solution through P(x,, y,)is shown dotted 
in Figure.10.1. Now we have to find the ordinate of any other point Q on 
this curve. 


True value of y 


y 
A Error 
Approx. value of y 
0 ~X 
L im im M 
X, xth x + 2h xt nh 
FIGURE 10.1 


Let us divide LM into n sub-intervals each of width h at L,, L, ---so that 
h is quite small 


In the interval LL,, we approximate the curve by the tangent at P. If the 
ordinate through L, meets this tangent in P(x, +h, y,), then 


y, =L,P,=LP +R P,=y,+ PR, tané 


dt 

= Yo +i(2) = Yo + hf. 4o) 
x}, 

Let PQ, be the curve of solution of (1) through P, and let its tangent at 


P, meet the ordinate through L, in P,(x, + 2h, y,). Then 
y=y, thfx, +h, y,) (1) 


Repeating this process n times, we finally reach on an approximation 
MP of MQ given by 


Yn = Yn + hf (xo +n- lh, Yn-1) 


This is Euler’s method of finding an approximate solution of (1). 


NOTE Obs. In Euler’s method, we approximate the curve of solution 

———__ by the tangent in each interval, i.e., by a sequence of short lines. 
Unless h is small, the error is bound to be quite significant. This 
sequence of lines may also deviate considerably from the curve 
of solution. As such, the method is very slow and hence there is 
a modification of this method which is given in the next section. 
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EXAMPLE 10.8 


Using Euler’s method, find an approximate value of y corresponding to 
x = 1, given that dy/dx =x + y and y = 1 when x = 0. 
Solution: 


We take n = 10 and h = 0.1 which is sufficiently small. The various cal- 
culations are arranged as follows: 


x y x+y =dy/dx Old y + 0.1 (dy/dx) = new y 
0.0 1.00 1.00 1.00 + 0.1 (1.00) = 1.10 
0.1 1.10 1.20 1.10 + 0.1 (1.20) = 1.22 
0.2 1.22 1.42 1.22 + 0.1 (1.42) = 1.36 
0.3 1.36 1.66 1.36 + 0.1 (1.66) = 1.53 
0.4 1.53 1.93 1.53 + 0.1 (1.93) = 1.72 
0.5 1.72 2,22 1.72 + 0.1 (2.22) = 1.94 
0.6 1.94 2.54 1.94 + 0.1 (2.54) = 2.19 
0.7 2.19 2.89 2.19 + 0.1 (2.89) = 2.48 
0.8 2.48 3.29 2.48 + 0.1 (3.29) = 2.81 
0.9 2.81 3.71 2.81 +0.1 (3.71) =3.18 
1.0 3.18 


Thus the required approximate value of y = 3.18. 


NOTE Obs. In Example 10.1(Obs.), we obtained the true values of y 
from its exact solution to be 3.44 where as by Euler's method 

y = 3.18 and by Picard’s method y = 3.434. In the above 
solution, had we chosen n = 20, the accuracy would have been 
considerably increased but at the expense of double the labor of 
computation. Euler’s method is no doubt very simple but cannot 
be considered as one of the best. 


EXAMPLE 10.9 
Given &y — J~* with initial condition y = 1 at x = 0; find y for x = 0.1 
dx yt+x 
by Euler’s method. 
Solution: 


We divide the interval (0, 0.1) in to five steps, i.e., we take n = 5 and 
h = 0.02. The various calculations are arranged as follows: 
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x y dy/dx Oldy + 0.02 (dy/dx) = new y 
0.00 1.0000 1.0000 1.0000 + 0.02(1.0000) = 1.0200 
0.02 1.0200 0.9615 1.0200 + 0.02(0.9615) = 1.0392 
0.04 1.0392 0.926 1.0392 + 0.02(0.926) = 1.0577 
0.06 1.0577 0.893 1.0577 + 0.02(0.893) = 1.0756 
0.08 1.0756 0.862 1.0756 + 0.02(0.862) = 1.0928 
0.10 1.0928 


Hence the required approximate value of y = 1.0928. 


10.5 Modified Euler’s Method 


In Euler’s method, the curve of solution in the interval LL, is approxi- 
mated by the tangent at P (Figure 10.1) such that at P,, we have 


Y =Ythfixy yo) (1) 
Then the slope of the curve of solution through P, 


li.e., (dy/dx)P, =f(x, +h, y,)] 
is computed and the tangent at P, to P,Q, is drawn meeting the ordinate 
through L, in 
Pit 2h, y): 
Now we find a better approximation yi? of y(x, +h) by taking the slope 


of the curve as the mean of the slopes of the tangents at P and P,, i.e., 


h 
yy = Yo +5 LF. Yo) + f(r +h,y,)] 


As the slope of the tangent at P1 is not known, we take y, as found in (1) 
by Euler’s method and insert it on R.H.S. of (2) to obtain the first modified 
value y,(1) 


Again (2) is applied and we find a still better value y vat corresponding 
to L, as 
@ Arey es ae 
Y Yo + 510.40) + fr + yi) 
We repeat this step, until two consecutive values of y agree. This is then 


taken as the starting point for the next interval L,L,. 


Once y, is obtained to a desired degree of accuracy, y corresponding to 
L, is found from (1). 
Yo = 4, + hflx, +h, y,) 


and a better approximation yy is obtained from (2) 


h 
ys" =Y1 + ol fle +hy,) + f (xo + 2h, ys)] 
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We repeat this step until y, becomes stationary. Then we proceed to calcu- 
late y, as above and so on. 


This is the modified Euler’s method which gives great improvement in 
accuracy over the original method. 


EXAMPLE 10.10 


Using modified Euler’s method, find an approximate value of y when 
x = 0.3, given that dy/dx =x + y and y = 1 when x = 0. 


Solution: 


The various calculations are arranged as follows taking h = 0.1: 


x xty=y Mean slope Old y + 0.1 (mean slope) = new y 
0.0 0+1 — 1.00 + 0.1 (1.00) = 1.10 
0.1 0.1+1.1 4(1+1.2) 1.00 + 0.1 (1.1) = 1.11 
0.1 0.14+1.11 1(1+1.21) 1.00 + 0.1 (1.105) = 1.1105 
0.1 0.1 + 1.1105 Ly + 1.2105) 1.00 + 0.1 (1.1052) = 1.1105 


Since the last two values are equal, we take y(0.1) = 1.1105. 
0.1 1.2105 — 1.1105 + 0.1 (1.2105) = 1.2316 


0.2 0.2 + 1.2316 4(1.12105 + 1.4316) 1.1105 + 0.1 (1.3211) = 1.2426 


0.2 0.2 + 1.2426 4(1.2105 + 1.4426) 1.1105 + 0.1 (1.3266) = 1.2432 


0.2 0.2 + 1.2432 1(1.2105 +1,4432) 1.1105 + 0.1 (1.3268) = 1.2432 


Since the last two values are equal, we take y(0.2) = 1.2432. 
0.2 1.4432 — 1.2432 + 0.1 (1.4432) = 1.3875 
0.3 0.3 + 1.3875 1.5654) = 1.3997 


1.4432 + 1.6875) 1.2432 + 0.1 


0.3 0.3 + 1.3997 1.5715) = 1.4003 


1.4432 + 1.6997) 1.2432 + 0.1 


0.3 0.3 + 1.4003 1 1.4432 + 1.7003) 1.2432 + 0.1 (1.5718) = 1.4004 


0.3 0.3+ 1.4004 | 1 1.4432 + 1.7004) 1.2432 + 0.1 (1.5718) = 1.4004 


Since the last two values are equal, we take y(0.3) = 1.4004. 
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Hence y(0.3) = 1.4004 approximately. 


NOTE Obs. In Example 10.8, we obtained the approximate value of y 
for x = 0.3 to be 1.53 whereas by the modified Euler’s method 
the corresponding value is 1.4003 which is nearer its true 
value 1.3997, obtained from its exact solution y = 2ex — x — 1 by 
putting x = 0.3. 


EXAMPLE 10.11 
Using the modified Euler’s method, find y(0.2) and y(0.4) given 
y’ =y +e, y(0) =0. 
Solution: 
We have y’ = y + ex =f (x, y);x =0, y =0 andh =0.2 


The various calculations are arranged as under: 


To calculate y(0.2): 
x ytex=y Mean slope Old y + h (Mean slope) 
= new y 
0.0 1 — 0+0.2 (1) =0.2 


0.2 |0.2421 + e°? = 1.4635 1c + 1.4635) = 1.2317 0 + 0.2 (1.2317) = 0.2463 


0.2 |0.2463 + e°? = 1.4677 0 + 0.2 (1.2338) = 0.2468 


(1 + 1.4677) = 1.2338 


ble 


Since the last two values of y are equal, we take y (0.2) = 0.2468. 


To calculate y(0.4): 
x y +ex Mean slope Oldy + 0.2 (mean slope) new y 
0.2] 0.2468 + e°? = 1.4682 — 0.2468 + 0.2 (1.4682) = 0.5404 


0.4} 0.5404 + e°4 = 2.0322 +(1.4682 + 2.0322) 0.2468 + 0.2 (1.7502) = 0.5968 


= 1.7502 


NUMERICAL SOLUTION OF ORDINARY DIFFERENTIAL EQUATIONS ° 435 


iG y tex Mean slope Oldy + 0.2 (mean slope) new y 
= 1.7784 
5 +e a9 2 95) = 
0.4} 0.6025 +e 0943 i 1.4682 + 2.0943) 0.2468 + 0.2 (1.78125) = 0.6030 
= 1.78125 
0.4} 0.6030 + e 2.0949 1 1.4682 + 2.0949) 0.2468 + 0.2 (1.7815) = 0.6031 
= 1.7815 
0.4 — 7 = 
0.4] 0.6031 +e = 2.0949 | 1.4 4682.4.2,9949) | 0.2468 + 0.2 (1.7815) = 0.6031 
= 1.7816 
Since the last two value of y are equal, we take y(0.4) = 0.6031 
Hence y(0.2) = 0.2468 an d y(0.4) = 0.6031 approximately. 
EXAMPLE 10.12 
Solve the following by Euler’s modified method: 
= log(x + y), y(O) = 2 
atx = Peed oo 
Solution: 
The various calculations are arranged as follows: 

x log (x+y) =y’ Mean slope Old y + 0.2 (mean slope) = new y 
0.0 log (O + 2) — 2+ 0.2(0.301) = 2.0602 
0.2 log 0.2 + 2.0602) $(0. 310 = 0.3541) 2+ 0.2 (0.3276) = 2.0655 
0.2 | log (0.2 + 2.0655) 4(0.301 + 0.3552) 2+ 0.2 (0.3281) = 2.0656 
0.2 0.3552 — 2.0656 + 0.2 (0.3552) = 2.1366 
0.4 | log (0.4 42.1366) | 2(0-3552 + 0.4042) 2.0656 + 0.2 (0.3797) = 2.1415 
0.4 log 0.4 + 2.1415) 7 (0.3552 + 0.4051) 2.0656 + 0.2 (0.3801) = 2.1416 
0.4 0.4051 — 2.1416+ 0.2 (0.4051) = 2.2226 
0.6 | log (0.6 + 2.2996) | 2(0.4051 + 0.4506) 2.1416 + 0.2 (0.4279) = 2.2 
0.6 | log (0.6 + 2.2272) + (0.4051 + 0.4514) 2.1416 + 0.2 (0.4282) = 2.2 
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rG log (x+y) =y’ Mean slope Old y + 0.2 (mean slope) = new y 
0.6 0.4514 — 2.2272 + 0.2 (0.4514) = 2.3175 
0.8 | log (0.8 + 2.3175) +(0.4514 + 0.4938) 2.2272 + 0.2 (0.4726) = 2.3217 
0.8 | log (0.8 + 2.3217) $(0.4514 + 0.4943) 2.2272 + 0.2 (0.4727) = 2.3217 
0.8 0.4943 — 2.3217 + 0.2 (0.4943) = 2.4206 
1.0] log (1+ 2.4206) $0.4943 + 0.5341) 2.3217 + 0.2 (0.5142) = 2.4245 


1.0 | log (1+2.4245) | 4(0.4943 + 0.5346) 2.3217 + 0.2 (0.5144) = 2.4245 


1.0 0.5346 — 2.4245 + 0.2 (0.5346) = 2.5314 
1.2 | log (1.2 + 2.5314) +(0.5346 +0.5719) 2.4245 + 0.2 (0.5532) = 2.5351 
1.2 | log (1.2 + 2.5351) +(0.5346 + 0.5723) 2.4245 + 0.2 (0.5534) = 2.5351 
1.2 0.5723 — 2.5351 + 0.2 (0.5723) = 2.6496 


1.4 | log (1.4 + 2.6496) 4(0.5723 + 0.6074) 2.5351 + 0.2 (0.5898) = 2.6531 


1.4 | log (1.44 2.6531) | 4(0.5723 +.0.6078) 2.5351 + 0.2 (0.5900) = 2.6531 


Hence y(1.2) = 2.5351 an d y(1.4) = 2.6531 approximately. 


EXAMPLE 10.13 
Using Euler's modified method, obtain a solution of the equation 
dy/dx =x + vy | 
with initial conditions y = 1 at x = 0, for the range 0 £ x £ 0.6 in steps of 0.2. 
Solution: 


The various calculations are arranged as follows: 


i ee Ja] =! Mean slope Old y + 0.2 
(mean slope) = new y 
0.0 0+1=1 — 1+0.2 (1) =1.2 
= 1.2954 mele 
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RG m +|V0] =y' Mean slope Old y + ve 
(mean slope) = new y 

0.2 024] J(2395)| 1(1 41.3088) 1 +0.2 (1.1544) = 1.2309 
= 1.3088 =e ere 

0.2 024 (2500) 1(1 41,3094) 1 +0.2 (1.1547) = 1.2309 
= 1.3094 mene 

0.2 1.3094 = 1.2309 + 0.2 (1.3094) = 1.4927 

04] 54 +| J@a9%)| 11,3094 + 1.6218) 1.2309 + 0.2 (1.4654) = 1.5240 
= 1.6218 ane 

Of) sayy | (O52) 1 (1.3094 + 1.6345) 1.2309 + 0.2 (1.4718) = 1.5253 
= 1.6345 = 14718 

04) a4 +| (5353) 11,3094 + 1.6350) 1.2309 + 0.2 (1.4721) = 1.5253 
= 1.6350 = L472] 

0.4 1.6350 = 1.5253 + 0.2 (1.635) = 1.8523 

0.6 0.6 + |(@.8523) 1(1.635 +1.961) 1.5253 + 0.2 (1.798) = 1.8849 
= 1.9610 sees 

061 og aliesa| | $.635+1.9729) 1.5253 + 0.2 (1.804) = 1.8861 
= 1.9729 een 

06) o64|(Gesen 11,635 +1.9734) 1.5253 + 0.2 (1.8042) = 1.8861 
= 1.9734 pete 


Hence y(0.6) = 1.8861 approximately. 


Exercises 10.2 


1. Apply Euler’s method to solve y’ =x + y, y(0) = 0, 
choosing the step length = 0.2. (Carry out six steps). 


2. Using Euler’s method, find the approximate value of y when x = 0.6 of 
dy/dx = 1 — 2xy, given that y = 0 when x = 0 (take h = 0.2). 


3. Using the simple Euler’s method solve for y at x = 0.1 from dy/dx = x + 


y + xy, y(0) = 1, taking step size h = 0.025. 
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4. Solve y’ =1-y, y(0) = 


by the modified Euler’s method and obtain y at x = 0.1, 0.2, 0.3 


5. Given that dy/dx =x? + y and y(0) = 1. Find an approximate value of 


y(0.1), taking h = 0.05 by the modified Euler’s method. 


6. Given y’ =x + sin y, y(0) = 1. Compute y(0.2) and y(0.4) with h = 0.2 


using Euler’s modified method. 


7. Given 4 dy _ Y~* with boundary conditions y = 1 when x = 0, find 


dx ytx 
approximately y for x = 0.1, by Euler’s modified method (five steps) 


8. Given that dy/dx= 2 + (xy) and y = 1 when x = 1. Find approximate 


value of y at x = 2 in steps of 0.2, using Euler’s modified method. 


10.6 Runge’s Method’ 


Consider the differential aquntions. iin f(x,y), y(%o) = Yo (1) 


Clearly the slope of the curve Reece P(x,, y,) is f(x, y,) (Figure 10.2). 
Integrating both sides of (1) from (x,, y,) to (x, +h, y, +k), we have 


yo +k Xo th 
fe dg= FP" fla gdx (2) 
Yo Xo 
ae 
YA 
Yo 
> 
’ L N M Xx 
~< Xo >|~ h a 

FIGURE 10.2 


*Called after the German mathematician Carl Runge (1856-1927). 
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To evaluate the integral on the right, we take N as the mid-point of LM 
and find the values of f(x, y) (i.e., dy/dx) at the points x,, x, + h/2, x, +h. For 


YO 
this purpose, we first determine the values of y at these points. 


Let the ordinate through N cut the curve PQ in S and the tangent PT in 
S,. The value of y, is given by the point S, 


Y, = NS, =LP+HS, = Yo + PH. tan0 


h 
= yo + hldy/dr), = Yo +5 fl%0,4o) (3) 


Also Yr = MT =LP+RT = yo + PR. tan = yy thf (xy + yo). 


Now the value of y, at x, + h is given by the point T" where the line 
through P draw with slope at T(x, +h, y,,) meets MQ. 


“. Slope at T =tan0'= f(xy th, yr) = flxo the yo + hf (xo, yo)! 
Yo =R+RT = yy + PR .tan8' = yy +hf [xy +h, yo +hf (Xo, Yo) (4) 


Thus the value of f(x, y) at P=f(x,, y,), 
the value of f(x, y) at S =f(x, + h/2, y,) 
and the value of fix, y) at Q =(x, +h, Yo) 
where y, and Yo are given by (3) and (4). 


Hence from (2), we obtain 
k= ‘ica f(x,y)dx = “Lhe +4 f+ fo by Simpson’s rule 


h 
=| fl + yg) + f(xy Fh/2, 45) + (ay +hyo | 


Which gives a sufficiently accurate value of k and also y =y, +k 
The repeated application of (5) gives the values of y for equi-spaced 
points. 


Working rule to solve (1) by Runge’s method: 


Calculate successively 
k, =hf (xq, Yo): 


1 1 
ky = it (x +o hyo +5h\| 


k' =hf (x th.yo +h) 
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and ka = hf (xp +h,yy +k’) 


Finally compute, k= alk + 4k, +ks) 
which gives the required approximate value as y, = y, +k. 
(Note that k is the weighted mean of k,, k,, and k,). 


yp Ya? 


EXAMPLE 10.14 


Apply Runge’s method to find an approximate value of y when x = 0.2, 
given that dy/dx =x + y and y = 1 when x = 0. 


Solution: 
Here we have x, = 0, y, = 1, h = 0.2, flx,, y,) =1 
k, =hf (xp, Yo) = 0.211) = 0.200 
1 

= atm - shy + ght =0.2f(0.1,1.1) 0.240 

k' =hf (x9 +hoyo +k) =0.2f (0.2,1.2) = 0.280 
and B= hf (xo +h, yy +k’) = 0.2 f (0.1,1.28) = 0.296 
k= a(k, +4k, +k3)= (0.200 + 0.960 + 0.296) = 0.2426 


Hence the required approximate value of y is 1.2426. 


10.7 Runge-Kutta Method* 


The Taylor’s series method of solving differential equations numerical- 
ly is restricted by the labor involved in finding the higher order derivatives. 
However, there is a class of methods known as Runge-Kutta methods which 
do not require the calculations of higher order derivatives and give greater 
accuracy. The Runge-Kutta formulae possess the advantage of requiring 
only the function values at some selected points. These methods agree with 
Taylor's series solution up to the term in h’where r differs from method to 
method and is called the order of that method. 


First order R-K method. We have seen that Euler’s method (Section 
10.4) gives 


Yi = Yo FPF (Xo> Yo) = Yo + hyo [sy =flx, y)] 
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Expanding by Taylor’s series 


, h? ” 
Yy = (xo +h) = yo + hyo rg + 


It follows that the Euler’s method agrees with the Taylor’s series solu- 
tion upto the term in h. 


Hence, Euler’s method is the Runge-Kutta method of the first order. 
Second order R-K method. The modified Euler’s method gives 
h 
m=ytslfleo, Yo) + f (xp +h, yn) (1) 


Substituting y, = y, + hf(x,, y,) on the right-hand side of (1), we obtain 


Y= vor Lf + f(x +h), Yo ae where fo=( Xl (2) 
Expanding L.H.S. by Taylor’s series, we get 
h? h? m 
1 = y (0 +h) = yo + hyo +40 +a Yo Tes (3) 


Expanding f(x, + h, y, + hf,) by Taylor’s series for a function of two 
variables, (2) gives 


y= well a {f= (x9, Yo) +n 7) + nf | voy | 


oye 3 sei (2) (2) | sow 


7 df (x,1 
= Yo thf ++ fi +0(h) : Hes) 72) 


Ds 


= yy thy, + yf +0(h°) (4) 


Comparing (3) and o it follows that the modified Euler’s method 
agrees with the Taylor’s series solution upto the term in h’. 


Hence the modified Euler’s method is the Runge-Kutta method of the 
second order. 


**O(h?) means “terms containing second and higher powers of h” and is read as order of h’. 
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“. The second order Runge-Kutta formula is 


1 
41 =Yo +o(k, +k) 
Where k, =hf (x,, y,) and k, = hf(x, +h, y, +k) 


(iti) Third order R-K method. Similarly, it can be seen that Runge’s meth- 
od (Section 10.6) agrees with the Taylor’s series solution upto the term in h®. 


As such, Runge’s method is the Runge-Kutta method of the third order. 
. The third order Runge-Kutta formula is 


1 
Yy _ Yo +o(k, + 4k, +k) 
1 1 
Where, ky =f (xo,Yo), ka =hf| Xo + oho ee 


And — ks =hf (xy +h,yy +k’), where k' =k, =hf (xo +h, yo +h) 


(iv) Fourth order R-K method. This method is most commonly used 
and is often referred to as the Runge-Kutta method only. 


Working rule for finding the increment k of y corresponding to an 
increment h of x by Runge-Kutta method from 


d 
Fen Soph yleo) 


is as follows: 


Calculate successively k, =hf(x,, y,), 


1 1 
ky = Ties + Fh Yo +5h 


1 1 
k, =i (x + 5h Yo +34,| 
and k, =hf (xp +h, yy +k) 


1 
Finally compute k= race + 2k, +2kz +k,) 
which gives the required approximate value as y, = y, +k. 


(Note that k is the weighted mean of k,, k,, k,, and k,). 


NOTE Obs. One of the advantages of these methods is that the 
———__ operation is identical whether the differential equation is linear 
or non-linear. 
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EXAMPLE 10.15 


Apply the Runge-Kutta fourth order method to find an approximate 
value of y when x = 0.2 given that dy/dx =x + y and y = 1 when x = 0. 


Solution: 
Here x, =0,y,=1Lh=0.2,flx, yy) =1 


k, = hf (xp, Yo) = 0.2 x l= 0.2000 


if 1 
ky = it x + sh. Yo +5h |= 0.2 x f(0.1,1.1) = 0.2400 


k, = at (x + shyo + sts] =0.2x f (0.11.12) = 0.2440 
and ky =hf (x9 +h,yo +s) =0.2X f (0.2,1.244) = 0.2888 
k==(k, + 2k, + Qkz +k,) 
= =(0.2000 + 0.4800 + 0.4880 + 0.2888) 
==x (1.4568) = 0.2428 


Hence the required approximate value of y is 1.2428. 


EXAMPLE 10.16 


22 

Using the Runge-Kutta method of fourth order, solve dy _ - = 

with y(0) = 1 atx = 0.2, 0.4. dx oy +x 
Solution: 

2 2 

We have f(x,y) = i 

yo rx 


To find y(0.2) 
Hence x, = 0, y, =1,h =0.2 


k, =hf (xo, yo) = 0.2 f (0,1) = 0.2000 


i 1 
ky =hf| xo + hyo toh =0.2x f(0.1,1.1) = 0.19672 
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ky =hf | xo + sh Yo + ok, = 0.2 f (0.1,1.09836) = 0.1967 
ky =hf (xp +h, yy +ks) = 0.2 f (0.2,1.1967) = 0.1891 
k==(k, + 2k, +2kz +k,) 


= slo2 + 2(0.19672) + 2(0.1967) + 0.1891] = 0.19599 
Hence y(0.2) = y, + k = 1.196. 
To find y(0.4): 
Here x, = 0.2, y, = 1.196, h = 0.2. 
k, =hf(x,,y,) =0.1891 


a ng + sha + shi = 0.2 f (0.3, 1.2906) = 0.1795 
1 1 
ka= ign + Pua + ake = 0.2 f (0.3,1.2858) = 0.1793 


ky =hf (x, +h,y, +k;) = 0.2 f (0.4,1.3753) = 0.1688 


k=2(ky + 2ky +2ky +k,) 


1 
= gl0.1891 + 2(0.1795) + 2(0.1793) + 0.1688] = 0.1792 


Hence y(0.4) =y, +k = 1.196 + 0.1792 = 1.3752. 


EXAMPLE 10.17 


Apply the Runge-Kutta method to find the approximate value of y for 
x = 0.2, in steps of 0.1, if dy/dx =x + y”, y = 1 where x = 0. 


Solution: 
Given f(x, y) =x + y?. 
Here we take h = 0.1 and carry out the calculations in two steps. 
Step I. x0 =0, yO=1,h=0.1 
k, =hf (xo, 49) = 0.1f (0,1) = 0.1000 
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ka = hr + 5h. +5 J 0.1f (0.05,1.1) = 0.1152 

k= hr + oh. +5, |= 0.1 f (0.05, 1.1152) = 0.1168 
p= (xo tho yo +ks) =0.1f (0.1,1.1168) = 0.1347 
“i + 2k, +2ky +k,) 


1 
= g (0.1000 + 0.2304 + 0.2336 + 0.1347) = 0.1165 
giving y(0.1) = yp +k =1.1165 
Step II. x, =x,+h=0.1, y= 1.1165, h =0.1 


k, =hf(x,,y,) =0.1f (0.1,1.1165) = 0.1347 


1 1 
ky = ng t ohn +54} 0.1f (0.15,1.1838) = 0.1551 


k= ig» +— shan + 3h )= 0.1f (0.15, 1.194) = 0.1576 


ky =hf (x, +h, yo +k) =0.1f (0.2,1.1576) = 0.1823 


k==(h, +2k, + 2k, +k,)=0.1571 


Hence y(0.2) = y, +k = 1.2736 


EXAMPLE 10.18 


Using the Runge-Kutta method of fourth order, solve for y at x = 1.2, 
14 


dy _ eles 


From given x, = 1, Y, =0 


dx x’ +xe* 


Solution: 


2xy +e" 


We have f(x,y) = 


2 x 
x” + xe* 


To find y(1.2): 
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Here x,=1, y,=0, h=0.2 


O+e' 
° =0.1462 
l+e' 


1+0.1 
b= v(x By +h). va] eM oa | 


ky =hf (xo, Yo) = 0.2 


(461) +0461)2" 
= 0.1402 


1 1 2(1+0.1)(0 +0.07)e"! 
k, =hf |x) +h, yo +—k, |= 0.2 . 
; s(x gr Ho's | eaReaneee 


= 0.1399 


= 7 ht = 2(1.2)(0.1399) e!? 
k, = hf (xp +/ Yo +ks) 02} (1.2) +(1.2)e! | 


= 0.1348 


1 i 
and k= glk + 2k, +2kz +ky)= gl0.1462 + 0.2804 + 0.2798 + 0.1348] 
= 0.1402 


Hence y(1.2) =y0+k=0 + 0.1402 = 0.1402. 
To find y (1.4): 


Here x, =1.2,y, =0.1402,h =0.2 
k, =hf(x,,y,) = 0.2 f (1.2,0) = 0.1348 
ky =hf (x; + h/2,y, +k,/2) = 0.2f (1.3, 0.2076) = 0.1303 
ks =hf (x; +h/2,y, +ko/2) = 0.2 f (1.3,0.2053) = 0.1301 
k, =hf (x, +h,y, +k,) = 0.2 f (1.3,0.2703) = 0.1260 
k=—=(k, + 2k, +2kz +k,) 
= [0.1348 + 0.2606 + 0.2602 + 0.1260] 


= 0.13038 
Hence y(1.4) = y, +k = 0.1402 + 0.1303 = 0.2705. 
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Exercises 10.3 


10. 


11. 


12. 


. Use Runge’s method to approximate y when x = 1.1, given that y = 1.2 


when x = 1 and dy/dx = 3x + y’. 


. Using the Runge-Kutta method of order 4, find y(0.2) given that dy/dx = 


3x + y’, y(0) = 1 taking h = 0.1. 


. Using the Runge-Kutta method of order 4, compute y(0.2) and y(0.4) 


dy 2 2 
from 10 ae x+y” y(0) =1, takingh = 0.1. 


. Use the Runge Kutta method to find y when x = 1.2 in steps of 0.1, given 


that dy/dx =x? + y?and y(1) = 1.5. 


. Given dy/dx = x° + y, y(O) = 2. Compute y(0.2), y(0.4), and y(0.6) by the 


Runge-Kutta method of fourth order. 


. Find y(0.1) and y(0.2) using the Runge-Kutta fourth order formula, 


given that y’ =x?— y and y(0) = 1. 


. Using fourth order Runge-Kutta method, solve the following equation, 


taking each step of h = 0.1, given y(0) = 3. dy/dx (4x/y — xy). Calculate y 
for x = 0.1 and 0.2. 


. Find by the Runge-Kutta method an approximate value of y for x = 0.6, 


given that y = 0.41 when x = 0.4 and dy/dx = /(x + y) 


. Using the Runge-Kutta method of order 4, find y(0.2) for the equation 


dy _ J7* | y(0)=1. Take h = 0.2. 
dx y+x’ 


Using fourth order Runge-Kutta method, integrate 
y’ =—2a° +12x° — 20x +8.5, using a step size of 0.5 and initial condition 
ofy =latx=0. 


Using the fourth order Runge-Kutta method, find y at x = 0.1 given that 
dy/dx = 3e* + 2y, y(0) =0 andh = 0.1. 

Given that dy/dx = (y? — 2x)/(y* + x) and y = 1 at x =0, find y for x = 0.1, 
0.2, 0.3, 0.4, and 0.5. 
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10.8 Predictor-Corrector Methods 


If x, , and x, are two consecutive mesh points, we have x,=x,, +h. In 
Euler’s method (Section 10.4), we have 


Yj =. thf (xp +i-lhey,1); i=12,3-- (1) 
The modified Euler’s method (Section 10.5), gives 


nyt oLPera ya) * Foy] 

The value of y, is first estimated by using (1), then this value is inserted 
on the right side of (2), giving a better approximation of y,. This value of y, 
is again substituted in (2) to find a still better approximation of y,. This step 
is repeated until two consecutive values of y, agree. This technique of refin- 
ing an initially crude estimate of y, by means of a more accurate formula 
is known as predictor-corrector method. The equation (1) is therefore 
called the predictor while (2) serves as a corrector of y,. 


In the methods so far described to solve a differential equation over an 
interval, only the value of y at the beginning of the interval was required. In 
the predictor-corrector methods, four prior values are needed for finding 
the value of y at x, Though slightly complex, these methods have the ad- 
vantage of giving an estimate of error from successive approximations to y,. 


We now describe two such methods, namely: Milne’s method and 
Adams-Bashforth method. 


10.9 Milne’s Method 


Given dy/dx = f(x, y) and y = y,, x =x,; to find an approximate value of 
y for x =x, + nh by Milne’s method, we proceed as follows: 


The value y, = y(x,) being given, we compute 
y= y(x, +h), Y.= y(x, + 2h), Y3= y(x, + 3h), 
by Picard’s or Taylor’s series method. 
Next we calculate, 
he = IX; Udidy =fix, +h, Wide =fix, + 2h, Godsds 7 I + 3h, Ys) 


Then to find y, = y(x, + 4h), we substitute Newton’s forward interpola- 
tion formula 


flxy) = fo +nAfy + nn D3 fot a 


BOON A fy te 
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In the relation 


xy t4h 
Ys = Yo + i f(x, y)dx 


2 


xy t4h n(n-1) .. 
4 =Y% +f. @ +nAf, + A? f, tf 
[Put x =x, + nh, dx = hdn| 


4 n(n-1) .. 
=yo+f. [fo tna # a fy 


2 


20 19 
= YW +h{ ay + SAT, +The +. 


Neglecting fourth and higher order differences and expressing 
Af, A” fy and A® f, and in terms of the function values, we get 


yi = Yo +S (af — f, +2 fs) 
which is called a predictor. 
Having found y,, we obtain a first approximation to 
fia = F(X + 4h, y4) 


Then a better value of y, is found by Simpson’s rule as 


h 
yi = Yo +i(h +4 fy; + fi) 
which is called a corrector. 


Then an improved value of f, is computed and again the corrector is 
applied to find a still better value of y,. We repeat this step until y, remains 
unchanged. Once y, and f, are obtained to desired degree of accuracy, y, = 
y(x, + 5h) is found from the predictor as 


: 4h 
yy =Yy + (2h —fs +2f;) 


and f, = f(x, + 5h, y.) is calculated. Then a better approximation to the value 
of y. is obtained from the corrector as 


r h 
ge =y3+s(f +4f, + fs) 


We repeat this step until y, becomes stationary and, then proceed to 
calculate y,, as before. 
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This is Milne’s predictor-corrector method. To insure greater accuracy, 
we must first improve the accuracy of the starting values and then sub- 
divide the intervals. 


EXAMPLE 10.19 


Apply Milne’s method, to find a solution of the differential equation 
y’=x-y in the range 0 <x < 1 for the boundary condition y = 0 at x = 0. 


Solution: 
Using Picard’s method, we have 

y=y(0)+ J, f(x,y)dx, where f(x,y)=x-y 
To get the first approximation, we put y = 0 in f(x, y) 


2 
Giving y, =04 fi xdk=— 


To find the second approximation, we put 
2 98 


wa x x4 x x 
ome w= fife ra ee 


Similarly, the third approximation is 


P oo ae 2 ge ae ae xg 
i= c—-|—-—| |dx=—-—+——- i 
ys= J i [ _ *=2 20 160 4400 (i 


Now let us determine the starting values of the Milne’s method from 
(i), by choosing h = 0.2. 


x, = 0.0, y= 0.0000, — f,= 0.0000 
x, = 0.2, y, = 0.020, f= 0.1996 
x, = 0.4, y,= 0.0795 —f,= 0.3937 
x,= 0.5, y,= 0.1762, — f,= 0.5689 


Using the predictor, y? =y) + “(25 — fy + 2fy) 
r=0.8 — y? =0.3049, —_f, = 0.7070 


h 
and the corrector, y(t =y+ mr fot4fat fi). yields 
yo) = ().3046 f,= 0.7072 (ii) 
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Again using the corrector, 
ge = 0.3046, , which is the same as in (ii) 


Now using the predictor, 
(p) 4h 
Yd =U +f =f, +2f,) 


x=0.1, yy? =0.4554 f= 0.7926 
h 
and the corrector y{) = y3 + mI fa t4fyt fs) gives 
ye 04555 «=f, 30.7925 
Again using the corrector, 
ys) = 0.4555, a value which is the same as before. 


Hence y(1) = 0.4555. 


EXAMPLE 10.20 


Using Milne’s method find y(4.5) given 5xy’ + y? — 2 = 0 given y(4) = 1, 
y(4.1) = 1.0049, y(4.2) = 1.0097, y(4.3) = 1.01438; y(4.4) = 1.0187. 


Solution: 
We have y' =(2- y V5x = f(x) [say] 
Then the starting values of the Milne’s method are 

x, =0, y=, i= —< = 0.05 

x=41, y= 1.0049, ff, = 0.0485 

x,=4.2,  y,=1.0097, f= 0.0467 

r,=43,  -y,=1.0143, —f, = 0.0452 

x,=4.4,  y,=10187, — f, = 0.0437 
Since y, is required, we use the predictor 

i = +f ft2fe) (h=0.1) 


: 4(0.1 
x=4.5, y! =1.0049+ MOV X 2.0467 — 0.0452 + 2 x 0.0437) = 1.023 
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a 2 
fp=—_ = 2= (1.023) _ 0.0424 
5x5 5X45 


Now using the corrector ys =y3+ *(f, + Af, + +4 , we get 


0.1 
ys) = 1.0143 + = (0.0452 +4 X 0.0437 + 0.0424) = 1.023 


Hence y(4.5) = 1.023 


EXAMPLE 10.21 


Given y’= x(x? + y*) e*, y(0) = 1, find y at x = 0.1, 0.2, and 0.3 by Taylor’s 


series method and compute y(0.4) by Milne’s method. 


Solution: 
Given y(0)=landh=0.1 
We have y'(x) = x(x? + ye \e* y'(0)=0 


y"(x) =[(a® + ay? le) + Bx? + y? +22y)y) Je“ 


=¢* [-x° —xy? +3x? +y? + 2xyy' | é y"(0)=1 
y"(x)=e* [-x° — xy? +3x7 + y? + 2xyy' — 6x — 2yy! — 2xy"— 2xyy' | 
y"(0) =9 


Substituting these values in the mers — 


=y(0)+= TE (oS vor, “y"(0)+-- 


y(0.1) =1+(0.1 o)+5 (0.1) (+e (0.1)? (—2) +--- 
= 1 + 0.005 — 0.0003 = 1.0047, i.e., 1.005 
Now taking x = 0.1, y(0.1) = 1.005, h = 0.1 
y’ (0.1) = 0.092, y" (0.1) = 0.849, y” (0.1) = —1.247 
es values in the Taylor's series about x = 0.1, 
0.1 1) 
y(0 =y(0.1)+> eT yy a 


y"(0.1) + y" (0.1) ++ 


=1.005+ (0.1)(0,092) + OY ” (0.849) + OD ye 1247) +--- 
=1.018 
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Now taking x = 0.2, y(0.2) = 1.018, h =0.1 
y!(0.2) = 0.176, y" (0.2) = 0.77, y"(0.2) = 0.819 


Substituting these values in the Taylor's series 


GI 0.1)° 
y(O 2) = y(0.2)+ 2 byr(o2) +4 1 y'(o2)+ 04 a y'"(0.2) +. 
= 1.018 + 0.0176 + 0.0039 - + 0.0001 
= 1.04 
Thus the starting values of the Milne’s method with h = 0.1 are 
%,=0.0, y= fo= Y= 9 
x,=0.1, — y, = 1.005 f, = 0.092 
x,=02,  y,=1.018 f,=0.176 
x,=0.3,  y,=1.04 f, = 0.26 


Using the predictor, y? =yot+ Saf, aoe ec 2 fs) 


=1+ [2(0.092) — 0.176 + 2.(0.26)] 


4(0.1) 
3 


= 1.09. 
x=0.4 y! =1.09, fr =y'(0.4) = 0.362 


h 
Using the corrector, yl = Yo + gl h +4f,+ ie yields 


0.1 
yf =0.018 +0176 + 4(0.26) + 0.362) = 1.071 
Hence y(0.4) = 1.071 


EXAMPLE 10.22 


Using the Runge-Kutta method of order 4, find y for x = 0.1, 0.2, 0.3 
given that dy/dx = xy + y?, y(O) = 1. Continue the solution at x = 0.4 using 
Milne’s method. 


Solution: 
We have fix, y) =xy + y’. 
To find y(0. 1): 
Here x, =0, y,=1,h=0.1. 
k, =hf (xo, yo) = (0.1) x f (0,1) = 0.1000 
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k= Atm + oh. + shi =(0.1) x f (0.05,1.05) = 0.1155 
a =i (x + Sho +5h,| =(0.1)x f (0.05, 1.0577) = 0.1172 
ky =hf (xo +h, yo +ks) = (0.1) x f (0.1,1.1172) = 0.13598 
k==(k, + 2k, +2kz +k,) 
= (0.1 + 0.231 + 0.2343 + 0.13598) = 0.11687 


Thus y(0.1) = y; =yo +k =1.1169 
To find y(0.2): 
Here x, = 0.1, y, = 1.1169, h=0.1 


k, =hf (x,,y,) =(0.1) x f (0.1, 1.1169) = 0.1359 


Tee sh yt sk i} (0.1) x f(0.15,1.1848) = 0.1581 


snide +—h,y, + ; k, »)- (0.1) x f (0.15, 1.1959) = 0.1609 
, =hf (x, +h,y, +ks) = (0.1) x f (0.2,1.2778) = 0.1888 


an + 2k, + 2k; +k,) = 0.1605 


Thus y(0.2)=y, =y, +k = 1.2773. 
To find y(0.3): 
Here x, = 0.2, y, = 1.2773, h = 0.1. 


k, =hf (x2, ya) = (0.1) x f (0.2, 1.2773) = 0.1887 
ky = it (x +Shoys + sh |= (0.1) x f (0.25,1.3716) = 0.2224 
k = Tie + sh Yo + hs] = (0.1) f (0.25, 1.3885) = 0.2275 


ky =hf (xs +h, ys +ks) = (0.1) f (0.3,1.5048) = 0.2716 
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k= alk + 2k, + 2k; +k,) = 0.2267 


y(0.3) = y3 =Yy +k = 1.504 


Now the starting values for the Milne’s method are: 


x, = 0.0 y, = 1.0000 f, = 1.0000 
x,=0.1 y, = 1.1169 f,= 1.3591 
x, =0.2 y, = 1.2773 f, = 1.8869 
x,=0.3 y, = 1.5049 f= 2.7132 
Using the predictor 


(p) 4h 
yd = Yo +2, — fe +2f,) 
x,=0.4 yi =1.8344 f, = 4.0988 


and the corrector, 


; h 
oe = Yo +(e +4f, + fi) 


y\) =1.2773+ “= [1.8869 + 4(2.7132) + 4.098] 


=1.8397 f,=4.1159. 
Again using the corrector, 
yy?’ =1.2773+ “=[1.8869 + 4(2.7132) + 4.1159] 
= 1.8391 f,= 4.1182 (i) 
Again using the corrector, 
yy? =1.2773+ “=[1.8869 + 4(2.7132) + 4.1182] 
= 1.8392 which is same as (i) 


Hence y(0.4) =1.8392. 


Exercises 10.4 


d 
1. Given - =x + y, y(O) = 2. The values of y(0.2) = 2.073, y(0.4) = 2.452, 
Av 


and y(0.6) = 3.023 are gotten by the R.K. method of the order. Find 
y(0.8) by Milne’s predictor-corrector method taking h = 0.2 


456 
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. Given 2 dy/dx = (1+ x*)y? and y(0) = 1, y(0.1) = 1.06, y(0.2) = 1.12, 


y(0.3) = 1.21, evaluate y(0.4) by Milne’s predictor corrector method. 


. Solve that initial value problem 


dt ; 
sen ht xy? ylO)= 


for x = 0.4 by using Milne’s method, when it is given that 


x: 0.1 0.2 0.3 
y: 1.105 1.223 1.355 


. From the data given below, find y at x = 1.4, using Milne’s predictor- 


corrector formula: dy/dx = x? + y/2: 


x=] 11 1.2 1.3 
y=2 2.2156 | 2.4549 | 2.7514 


d 
. Using Taylor’s series method, solve : =xy + x7, y(0) = 1; atx =0.1, 


0.2, 0.3. Continue the solution at x = 0.4 by Milne’s predictor-corrector 
method. 


. Ify = 2e*-y, y(0) = 2, y(0.1) = 2.01, y(0.2) = 2.04, and y = 2.09, find 


y(0.4) using Milne’s predictor-corrector method. 

Using the Runge-Kutta method, calculate y (0.1), y(0.2), and y(0.3) 
dy 2xy 
dx 1+x? 
ues, find y(0.4) by Milne’s method. 


given that =1. y(0) =0. Taking these values as starting val- 


10.10 Adams-Bashforth Method 


d 
Given = = f(x,y) and y, =y(x,), we compute 
AY 


Yy-1 = y(%q —h), y_g = ylxy — 2h), y_3 = y(%q — 3h) 


by Taylor’s series or Euler’s method or the Runge-Kutta method. 


Next we calculate 
fa = f(%q —h,y-1), fe = f%q — 2h, y_2), f_3 = f(x — 3h, ys) 
Then to find y,, we substitute Newton’s backward interpolation formula 
n(n +1) n(n+1)(n+2 


f(x,y) = fo + nVfo + os * fy + — ty fot 
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. xg th 
an Yi = Yo + S, f(x,y) (1) 
n(n+ at 
= Yo +f" ‘(h +nVfo + Vi fo + «fa 


[Put x =x, + nh, dx = hdn|] 
eta 


1 n(n 
= th fi(fi +nvh+ 
1 5 3 
= Yo hl f +, Vio arr | rade | 


Neglecting fourth and higher order differences and expressing 
Vfy. V’ fo and V*f, in terms of function values, we get 


h 
Yr = Yo t 54 (55.0 - 5Of_) +37f..—9f-s) (2) 
This is called the oe en predictor formula. 
Having found y,, we find f, = f(x, +h,, y,). 


Then to find a better value of y1, we derive a corrector formula by sub- 
stituting Newton’s backward formula at f1, i.e., 


n(n +1) nnt+1)(n+2 
f(xy)= fi tnVf, + 


mnt Dye f+ nthe ie 


n=yorf engi dasa ON pe Hh 


[Put x =x, + nh, dx =h dn] 


ane 


1 1 _, 1 
= wh h-SVi- Bh yh +) 


Neglecting fourth and higher order differences and expressing 
Vf,,V’ f, and V° f, and in terms of function values, we obtain 


in (1) 


0 nn 
= Yo flr +nVf, + 


aa = Yo + Hof +19f) -—5f_, +9f-5) 


which is called the Hise: eee corrector formula. 
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Then an improved value of f1 is calculated and again the corrector (3) is 
applied to find a still better value y1. This step is repeated until y, remains 
unchanged and then we proceed to calculate y, as above. 


NOTE Obs. To apply both Milne and Adams-Bashforth methods, we 
require four starting values of y which are calculated by means 
of Picard’s method or Taylor’s series method or Euler’s method 
or the Runge-Kutta method. In practice, the Adams formulae 
(2) and (3) above together with the fourth order Runge-Kutta 
formulae have been found to be the most useful. 


EXAMPLE 10.23 


Given Da x2(1+y) and y(1) = 1, y(1.1) = 1.233, y(12) = 1.548, 
X 


y(1.3) = 1.979, evaluate y(1.4) by the Adams-Bashforth method. 
Solution: 
Here f(x, y) =x°(1 + y) 
Starting values of the Adams-Bashforth method with h = 0.1 are 


x = 1.0, y_, = 1.000, if = (1.0)7(1 + 1.000) = 2.000 
x= 11, y= 1.233, ff, = 2.702 

c= 2. y= 1.548, ie = 3.669 

x= 13, y,=1.979, f= 5.035 

Using the predictor, 


3 h 
yi” = Yo +5; (55.fo — 59F peel 8p. s) 


x,=14, yf) =2573 f,=7.004 


Using the corrector 
‘ h 
yi = Yo +5, (9f +19 fy —5f_) + fa) 


0.1 
y\ =1.979 + Sr X 7.004 + 19 X 5.035 —5 X 3.669 + 2.702) = 2.575 


Hence y(1.4) = 2.575 
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EXAMPLE 10.24 
If = 2e*y, y(0) = 2, find y(4) using the Adams predictor corrector 
Kc 


formula by calculating y(1), y(2), and y(3) using Euler’s modified formula. 
Solution: 


We have fix, y)=2e*y 


48 2e"y Mean slope Oldy + h (mean slop) = new y 
0 4 24+0.1(4) = 2.4 

0.1 9¢°(2.4) = 5.305 1(4.45,305) = 4.6524 2+ 0.1 (4.6524) = 2.465 
2 Uv. == . i 

0.1 2e'(2.465) = 5.449 3(¢ a 2'4e2) =F \Stt 2.40.1 (4.7244) = 2.472 
? = 

0.1 2e"\(2.4724) = 5.465 1(4 45 465) = 4.7394 240.1 (4.7324) = 2.473 
2 . t — . 

0.1 |  26°1(2.478) = 5.467 1(4.45,467) = 4.7333 2 + 0.1 (4.7333) = 2.473 
2 Us —— . 

0.1 5.467 — 2+ 0.1 (5.467) = 3.0199 

0.2 2e?(3.0199) = 7.377 1(5,467 s. 7.377) =§ 499 2.473 + 0.1 (6.422) = 3.1155 

0.2 7.611 1(5,467 4. 7.611) = 6.539 2.473 + 0.1 (6.539) = 3.127 

0.2 7.639 1(5,467 4 7.639) =6 553 2.473 + 0.1 (6.553) = 3.129 

0.2 7.643 1(5,467 at 7.643) 6 BRR 2.473 + 0.1 (6.555) = 3.129 

0.2 7.463 — 3.129 + 0.1 (7.643) = 3.893 

0.3 2e°3(3.893) = 10.51 1(7 643 +10 51) =9.076 3.129 + 0.1 (9.076) = 4.036 

2 . at aaah . 

0.3 10.897 (7,643 a 10.897) = 966 3.129 + 0.1 (9.2696) = 4.056 

0.3 10.949 1(7,643 +10.949)=9.296 | 3:129+0.1 (9.296) = 4.058 

0.3 10.956 1(7.643 10.956) = 9.299 3.129 + 0.1 (9.299) = 4.0586 


To find y(0.4) by Adam’s method, the starting values with h = 0.1 are 


x= 0.0 y = 24 f,=4 

x=0.1 Y= 2.473 f.= 5.467 
x=0.2 y_, = 3.129 f= 7.643 
x= 0.3 y= 4.059 f= 10.956 
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Using the predictor formula 


(p) h 
yi = Yo +57 (55 fo — 59 fF, +37 fo - OF. «) 


= 4,059 + S655 x 10.957 — 59 X 7.643 + 37 X 5.467 —9 x 4) 
= 5,383 

Now x=0.4 y, =5.383 f, =2e°* (5.383) = 16.061 

Using the corrector formula 


2 h 
Hi = 90+ 5, Of +19fy Sf + fs) 


0.1 
= 4.0586 + 0 x 16.061 +19 X 10.956 —5 x 7.643 + 5.467) 


= 5.392 
Hence y(0.4) = 5.392 


EXAMPLE 10.25 


Solve the initial value problem dy/dx =x — y’, y(0) = 1 to find y(0.4) by 
Adam’s method. Starting solutions required are to be obtained using the 
Runge-Kutta method of the fourth order using step value h = 0.1 


Solution: 

We have f(x, y) =x -y’. 
To find y(0. 1): 

Here x, = 0, y,=1,h=0.1. 


k, =hf (xo,4o) = (0.1) f(0,1) = -0.1000 
k= Atm + sh Yo + =k; = (0.1) f (0.05,0.95) = -0.08525 
k, =hf | xy + sh. yo + ahs = (0.1) f (0.05,0.9574) = —0.0867 


k, =hf (xo +h, yy +s) = (0.1) f (0.1,0.9137) = 0.07341 


k= alk +2k, + 2k +k,)0=—0.0883 
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Thus y(0.1)= y, = yy +k =1—0.0883= 0.9117 
To find y(0.2): 
Here x, = 0.1, y,=0.9117,h=0.1 
k, =hf (x,,y,) =(0.1)x f (0.1,0.9117) = -0.0731 


k, = hf mt+> ae mts =f | (0.1) f (0.15, 0.8751) = 0.0616 


— + ohm +h, }= (0.1) f (0.15,0.8809) = 0.0626 
4 =hf (x, +h,y, +k) =(0.1) x f (0.2,0.8491) = 0.0521 
k= me + 2k, + 2k +k,) = 0.0623 


Thus y(0.2)=y,=y, +k =0.8494. 
To find y(0.3): 
Here x, = 0.2, y, = 0.8494, h = 0.1. 
k, =hf (x2,y2) = (0.1) x f (0.25, 0.8494) = 0.0521 


ky =hf | x5 + Shays + 3h =(0.1) f (0.25,0.8233) = 0.0428 


k = it (x + sh Yo + hs] = (0.1) f (0.25,0.828) = 0.0436 
ky =hf (x2 +h, ys + ks) = (0.1) f (0.3,0.058) = 0.0349 


k= alk + 2k, + 2k +k,) = 0.0438 


Thus (0.3) = y3 = yp +k = 0.8061 

Now the starting values for the Milne’s method are: 

x,=0.0  y,=1.0000 f= 0.0- (0.1)? = 1.0000 

x, =0.1 y, = 9.9117 f= — (0.9117)? = -0.7312 
x, = 0.2 y, = 0.8494 f,= 0.2 — (0.8494)? = -0.5215 
x,=03 y,=0.8061 —f, = 0.3- (0.8061)? = -0.3498 
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Using the predictor, 


(p) h 
yi = Yo +57 (55 fo — 59 f1 +37 fo - Of 3) 


x = 0.4 
0.1 
y\’ = 0.8061 +5 (55(— 0.3498) - 59(—0.5215) + 37(—0.7312) —9(—1)) 
=0.7789 f, =—0.2.67 


Using the corrector, 


h 
yy y= Yo +5, 0h WI [S74 + fs) 


0.1 
y\” = 0.8061 + ore (—0.2067) +19 x (—0.3498) — 5(—0.5215) — 0.7312] 


= 0.7785 
Hence y(0.4) = 0.7785 


Exercises 10.5 


1. Using the Adams-Bashforth method, obtain the solution of dy/dx =x — y” 
at x = 0.8, given the values 

x: 0 0.2 0.4 0.6 

y: 0 0.0200 0.0795 | 0.1762 


2. Using the Adams-Bashforth formulae, determine y(0.4) given the dif- 
ferential equation dy/dx = any and the data: 


x: 0 0.1 0.2 0.3 

Y: 1 1.002 |51.0101} 1.0228 

3. Given y’ =x°—y, y(0) = 1 and the starting values y(0.1) = 0.90516, 
y(0.2) = 0.82127, y(0.3) = 0.74918, evaluate y(0.4) using the Adams- 
Bashforth method. 


4. Using the Adams-Bashforth method, find y(4.4) given 5xy’ + y? = 2, 
y(4) =], y(4.1) = 1.0049, y(4.2) = 1.0097 and y(4.3) = 1.01438. 

5. Given the differential equation dy/dx =x°y + x* and the data: 

x: 1 Til 12 1.3 


y: 1 1.233 1.548488 | 1.978921 
determine y(1.4) by any numerical method. 
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6. Using the Adams-Bashforth method, evaluate y(1.4); ify satisfies dy/dx 
+ y/x = 1/x? and y(1) = 1, y(1.1) = 0.996, y(1.2) = 0.986, y(1.3) = 0.972. 


10.11 Simultaneous First Order Differential Equations 


The simultaneous differential equations of the type 


dy 7 
Fe FO 52) (1) 
and - = P(x, y,%) (2) 


with initial conditions y(x,) = y, and z(x,) =z, can be solved by the meth- 
ods discussed in the preceding sections, especially Picard’s or Runge-Kutta 
methods. 


Picard’s method gives 
n= Yo +f fle yosrolde, a = 20 + f Gx. yo.zo)de 
yo = yo + f fla qya dv, xo = 2 + f Ole. de 
us = Yo + f fl. Yos%oddee x =e + f blo. yo,co\de 

and so on. 

(ii) Taylor's series method is used as follows: 


If h be the step-size, y, = y(x, + h) and z, = (x, + h). Then Taylor’s al- 
gorithm for (1) and (2) gives 


h? h? 
M1 = Yo thyo +> Yo +40 + (3) 
' h? " i m 
% = &q hey +5 eo + 37% +o (4) 


Differentiating (1) and (2) successively, we get y”, 2”, etc. So the values 
Yo. Yo.Yo°: and %9,29,%9°*: are known. Substituting these in (3) and (4), we 
obtain y,, z, for the next step. 


Similarly, we have the algorithms 
2 3 


y=nthyt outst 


464 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


2 3 
+— zh + 
g)7 3! 
Since y, and z, are known, we can calculate y;,y/,--- and 2,,21,-++. Sub- 
stituting these in (5) and (6), we get y, and z,,. 


Zo =, they ate (6) 


Proceeding further, we can calculate the other values of y and z step 
by step. 


(iit) Runge-Kutta method is applied as follows: 


Starting at (x,, y,, z,) and taking the step-sizes for x, y, z to be h, k,l 
respectively, the Runge-Kutta method gives, 


ky =hf (X,Yo.%0) 
L= hP(x9,Yo.%0) 


1 1 1 
ky = atx +5 hYo + he +5h 


1 1 
I =ho(m +5 —h Yo + sky.t9 + 3h 


1 1 1 
ks =f (a9 +h +o het + 3h] 
1 1 1 
Is = holm + Fh Yo +5 he.to + 3] 
1 1 
ky =hf [no +5 —h Yo to kako + 5's ] 
1 1 
lL, =ho tpt a Yo +S hs.% tos 
Hence Yy = Yo +2(k; + 2k, + 2k, +k,) 


1 
and Pa = yo teh +21, +2ls +1,) 
To compute y, and z,, we ee replace x,, Yq 2) by x,, y,, 2, in the 
above formulae. 
EXAMPLE 10.26 


Using Picard’s method, find approximate values of y and z correspond- 
ing to x = 0.1, given that y(0) = 2, z(0) = 1 and dy/dx =x +z, dz/dx =x — y?. 
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Solution: 

Here x, = 0, y, = 2, 2, = 1, 
d 

and seo foayalate 
7 P(x, y,z) = x-y? 


y= yo J) foayalde and 2=25 + J" ple.yaddr 
First approximations 
t x 1. 
Y1 = Yo +f Fleyo.zpdx=24 J (x +1)dx =2+x+=x7 
Xo Xo 2, 
x x 1 5) 
Z =, + X, Yy,Zy) dx =1+ x — 4)dx =1—4x +=x7 
1 = %0 ]. P(x, Yo.%0) i ( Md. 9 
Second approximations 


y= orf. floymdc=2+ J (404 Sx" ide 


Sy 
=24+y—-2 2 4 
2 6 
x x 1 2 
2=2zotf Oxy aide=lt J [x—-l2tx+—=2°] be 
9 0 J, ee a )dx pif ( x te) fas 
3 445 
Sl=4p$ =, oe, 
2 4 20 
Third approximations 
: a ne | ig. vs 
Yo=Yot J. flyamWe= 242-52" a9 — Tat <a a8 
33 =atf P(X, Yo 2 dx 
3.5, 5 7 31 1 «© 1 | 
= 1-4 +4? +43 + — xt —-= 3° + — 7 - x! 
2 3 12 60 12 252, 
and so on. 
When x=0.1 
y, = 2.105, y,= 2.08517, y= 2.08447 


z, = 0.605, z, = 0.58397, z, = 0.58672. 
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Hence y(0.1) = 2.0845, 2(0.1) = 0.5867 


correct to four decimal places. 


EXAMPLE 10.27 


Find an approximate series solution of the simultaneous equations dx/ 
dt = xy + 2t, dy/dt = 2ty + x subject to the initial conditions x = 1, y = - 1, 


£=0. 
Solution: 


x and y both being functions of t, Taylor’s series gives 
2 3 
and ut) =a + ix +3729 + ag + 
2 3 
yt) = Yo + iyo +240 + 3740 t 


Differentiating the given equations 


x’ = xy + 2t 
y' = 2tyt+x 
w.r.t. f, we get 
x" = xy’ +x'y +2 y= Qty’ + 2y+x' 
Sa = (xy" + x'y') + x"y + xy’ vi = 2ty" + 2y’ + 2y’ + a” 
Putting x, = 1, y, =— 1, t, = 0 in (ii), (iii), and (iv), we obtain 
% =-1+2(0)=-1 yo =1 
Xo =XyYo +xOYo + 2 yo =9 +2yy +x 
=11 +(-1)(-1)+2=4 =2(-1)+(-l)=-3 


x” =-3+(- 1)(1)+4(-1)-1=-9 | wo=2+2+4=8etc 


Substituting these values in (i), we get 


a i se 
x(t)=1-t+4—+(-9)—4+---=1-¢4+2t° --t? ++ 
2! 3! 2 


ie 


2! 


3 


t 3.5 4 
x(t)=1+t+3—+8—+--=1lt+t- P+ +e 
3! 2 3 
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EXAMPLE 10.28 


Solve the differential equations 

dy dz 

———— 1 + xz.— 

dx re dx 

using the fourth order Runge-Kuta method. Intial values are x = 0, 
y=0,2=1. 


=—xy forx =0.3 


Solution: 
Here f(x,y, z)=1 + xz, G(x, y, z)=—xy 
x, = 0, y, =9, %, = 1. Let us take h = 0.3. 
k =f (Xs Yor %q) = 0.3 (0, 0, 1) =0.3 (1 +0) =0.3. 
L, =h@(x,49.%) =0.3(-0 x 0)=0 


1 1 1 
ky = atx +5 ,4 +h Ro +5 
= (0.3) f (0.15,0.15,1) = 0.3(1 + 0.15) = 0.345 
1 1 1 
l, = hol +5) Y4 +5 %o +54 


=(0.3)[—(0.15)(0.15)] =—0.00675 


] k, l 
ky =hf(m + 5hayy + 50 + 7 


= (0.3) f (0.15,0.1725, 0.996625) 
= 0.3[1 + 0.996625 x 0.15] = 0.34485 


1 k. l. 
ls = hl» + 5h 4 + 570 7 2) 


= 0.3[—(0.15)(0.1725)] =—0.007762 


ky =hf (x thy yy +k3,% +1;) 
= 0.3 f (0.3,0.34485, 0.99224) = 0.3893 


= ho(x th,yo + ks, +1;) 
= 0.3[—(0.3)(0.34485)] =—0.03104 


Hence y(xp +h)= yo + ak + 2k, + 2ks +k,) 
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i 
y(0.3) =0+ 5103 + 2(0.345) + 2(0.34485) + 0.3893] = 0.34483 


i.€., 
1 
and a(x th)= yo + e(h + 2b +215 +1,) 
ie. 2(0.3) =1+ lo + 2(—0,00675) + 2(0.0077625) + (—0.03104)| 


= 0.98999 


10.12 Second Order Differential Equations 


Consider the second order differential equation 
d°y a 
ae [s i 
By writing dy/dx =, it can be reduced to two first order simultaneous 


differential Equations 


These equations can be solved as explained above. 


EXAMPLE 10.29 
Find the value of y(1.1) and y(1.2) from y” + y’y’ = x8; y(1) = 1, y’1) = 
1, using the Taylor series method 


Solution: 
Let y’=zso that y” =z’ 
Then the given equation becomes 2’ + y*% = 5 
y’ =% 
2 = -y'Z (i) 
such that y(1) =1,2(1)=1,h=0.1. (ii) 


Now from (i) y’=2,y"=2,y" =z 


and from (ii) =z" =6x— (y?2" + 2yy'z')- 2(y z+ y xz 


= 6x—(y?x" + 2yz)— a(z3 f 2yzz') 


NUMERICAL SOLUTION OF ORDINARY DIFFERENTIAL EQUATIONS ° 469 


Taylor's series for y(1.1) is 
y(1.1) = y(1) + hy'(L) + a4 “') ne 7 “y"(1) ‘hy 
Also y)=Ly')=1 y= =2'1)=0,y")=2")=1 


_ (0. us (0)4 (0. > 


y(1.1) =(1)+0.10 (0) = 1.1002. 


Taylor's series for z(1.1) is 
h2 h? 
2(1.1) = 2(1) + hz'(1) +52") +e") +... 


Here 2H=L2(HY)=02"HD=L2")=3 
(0. vw 


2(1.1)= (1) +0.1(0) + Oy (1)+ (3) =1.0055 


Hence y(1.1) = 1.1002 and z(1.1) = 1.0055. 


EXAMPLE 10.30 
Using the Runge-Kutta method, solve y” = xy’? — y? for x = 0.2 correct 
to 4 decimal places. Initial conditions are x = 0, y = 1, y’ = 0. 
Solution: 


Let dy/dx =z =f(x, y, 2) 


d 
Then 7 xz —y” = (x,y,2) 


We have x, = 0, y, = 1, z, =0,h = 0.2 


70 


EP me formulae become 
k, =hflx,, Yo, %) = 0.2(0) = 0 
1 1 1 
ky =i (1, + 5h 4 +e +5h | 
=0.2(— 0.1) =— 0.02 
1 1 1 
k, = it {>, + 5h 4 +5 ke % + 5h] 
=().2(— 0.0999) = 0.02 
k, =hf (x, +h.yy +ks.% +3) 
=0.2(— 0.1958) = 0.0392 
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1 
k= rac + 2k, + 2k, +k,)=0.0199 
1 =hf(x,, y,, #0) = 0.2(- 1) =- 0.2 
1 1 1 
lL = ho + 3 hYo + 9 M170 + | 
= 0.2(—0.999) = —0.1998 
1 1 1 
l, = hol + 3b Yo + 582% + 3] 
= 0.2(— 0.9791) = —0.1958 
L, =ho(xy +h, yy +k3.2y +15) 
= (.2(0.9527) = —0.1905 


l= s(t +21, +21, +1,)=—0.1970 
Hence at x = 0.2, 
y =y, +k = 1-0.0199 = 0.9801 
and y’ =z =2z0 +1 =0 —0.1970 =- 0.1970. 


EXAMPLE 10.31 


Given y” + xy’ + y = 0, y(0) = 1, y’(0) = 0, obtain y for x = 0(0.1) 0.3 by 
any method. Further, continue the solution by Milne’s method to calculate 


y(0.4). 
Solution: 


Putting y’ = z, the given equation reduces to the simultaneous equa- 
tions 


z'+xz+y=0,y' =z (1) 
We employ Taylor's series method to find y. 
Differentiating the given equation n times, we get 
Yio t X,,,+ ny, +y, =0 
At x=0, (y,,,))=-(n+ l)ly,), 
y(0) = 1, gives y,(0) =— 1, y,(0) =3, y,(0) =-5 x 3, 
and =, (0) = 0 yields y,(0) = y,(0) = ...... =0. 
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Expanding y(x) by Taylor’s series, we have 
2 3 


yx) = y(0) + x4 (0) + yo 0) += ys(0) + 


9. 
Pao Ja 34 5X3 ; 
y(x) =1 a a 61 x fe (2) 
’ 1 3 1 5 
and ala) = ya) =—xt oa =a ++ =—xy, (3) 
From (2), we have 
0.1) 1 
gorse = + (0.1)! =-+= 0.995 
Hey. (02) 
y(0.2)=1- 02 4 02) <9. g800 
2 8 
2 4 6 
Ogata! , (0.3) _ (0.3) wees 


2 8 48 
From (3), we have 


2(0.1) = — 0.0995, z(0.2) = — 0.196, z(0.3) = — 0.2863. 
Also from (1), 2’(x) =— (xz + y) 
z’(0.1) = 0.985, z’(0.2) =— 0.941, 2’(0.3) =— 0.87. 
Applying Milne’s predictor formula, first to z and then to y, we obtain 
2(0.4)==(0)+ §(0.1){22"(0.0 ~ 2!(0.2) + 22'(0.3)} 


0.4 
=0 +(e. 1.79 + 0.941-1.74} = 0.3692 


and y(0.4) = y(0) +5(0.1){2y(.) — ¥/(0.2) + 2y'(0.3)} [ee y’ =a 
=(0+ Gas 0.199 +.0.196 — 0.5736} = 0.9231 


Also 2’(0.4) =— {x(0.4) 2(0.4) + y(0.4)} 
= — {0.4(— 0.3692) + 0.9231} =— 0.7754. 


Now applying Milne’s corrector formula, we get 


=(0.4) = 2(0.2)+ *{2(0.2) +42'(03)+2/(0.4)} 


0.1 
=-0.196+{ : \ 0.941 — 3.48 — 0.7754} = —0.3692 
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and —_y(0.4)=y(0.2)+ ={y(0.2) + 4y!(0.3)+ y'(0.4)} 


= 0.9802 + (*2 \ 0.196 — 1.1452 — 0.3692} = 0.9232 


Hence y(0.4) = 0.9232 and z(0.4) =— 0.3692. 


Exercises 10.6 


1. Apply Picard’s method to find the third approximations to the values of y 
and z, given that 
dyldx =z, dz/dx =x*(y +2), given y = 1, z = 1/2 when x =0. 


2. Using Taylor’s series method, find the values of x and y for ¢ = 0.4, 
satisfying the differential equations 
dx/dt =x + y + t, d’y/dt? = x —t with initial conditions x = 0, y = 1, 
dy/dt =— 1 att =0. 
3. Solve the following simultaneous differential equations, using Taylor 
series method of the fourth order, for x = 0.1 and 0.2: 
dy dz 
Fn 1S == xy:y(0) = 1. 
dx : dy xysy (0) 
4. Find y(0.1), z(0.1), y(0.2), and z(0.2) from the system of equations: y’ = 
x+2,2' =x—y? given y(0) =0, z(0) = 1 using Runge-Kutta method of the 
fourth order. 


5. Using Picard’s method, obtain the second approximation to the solution 


of 
d°t dy ; 1 
=x . +x°y so that y(0)=1y'(0)= 2 
6. Use Picard’s method to approximate y when x = 0.1, given that 
d2y d°y dy dy 
= + 2a + 2a +y=0and Ue ai when x = 0. 


7. Find y(0.2) from the differential equation y” + 3xy’ — 6y = 0 where y(0) 
= 1, y’(0) = 0.1, using the Taylor series method. 


8. Using the Runge-Kutta method of the fourth, solve y” = y + xy’, y(0) = 1, 
y’(0) = 0 to find y(0.2) and y’(0.2). 
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9. Consider the second order initial value problem y” — 2y’ + 2y = e” sin t 
with y(0) =— 0.4 and y’(0) =— 0.6. Using the fourth order Runga-Kutta 
method, find y(0.2). 


10. The angular displacement @ of a simple pendulum is given by the equa- 
tion 


where / = 98 cm and g = 980 cm/sec”. If 6 = 0 and d6/dt = 4.472 at t = 0, 
use the Runge-Kutta method to find 6 and d@/dt when t = 0.2 sec. 


11. InaL-R-C circuit the voltage v(t) across the capacitor is given by the 
equation ' 
169 476" p30 
dt” dt 
subject to the conditions t = 0, v = v,, dv/dt = 0. 
Taking h = 0.02 sec, use the Runge-Kutta method to calculate v and 
dv/dt when t = 0.02, for the data v, = 10 volts, C = 0.1 farad, L = 0.5 henry 
and R = 10 ohms. 


10.13 Error Analysis 


The numerical solutions of differential equations certainly differ from 
their exact solutions. The difference between the computed value yi and the 
true value y(xi) at any stage is known as the total error. The total error at 
any stage is comprised of truncation error and round-off error. 


The most important aspect of numerical methods is to minimize the 
errors and obtain the solutions with the least errors. It is usually not pos- 
sible to follow error development quite closely. We can make only rough 
estimates. That is why, our treatment of error analysis at times, has to be 
somewhat intuitive. 


In any method, the truncation error can be reduced by taking smaller 
sub-intervals. The round-off error cannot be controlled easily unless the 
computer used has the double precision arithmetic facility. In fact, this er- 
ror has proved to be more elusive than the truncation error. 


Leg 
The truncation error in Euler’s method is gi yn", i.e., of (h?) while 


that of modified Euler’s method is shi i.e., of (h°) 


nl>* 
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Similarly in the fourth order of the Runge-Kutta method, the trunca- 
tion error is of O(h*). 


In the Milne’s method, the truncation error 


14 1s 
due to predictor formula = 45! He 


vz5 
ih. 


1 
and due to corrector formula = ae) 


i.e., the truncation error in Milne’s method is also of O(h*). 


Similarly the error in the Adams-Bashforth method is of the fifth order. 
Also the predictor error T,, and the corrector error T, are so related that 
1oT,~- 251 T.. 


The relative error of an approximate solution is the ratio of the total 
error to the exact value. It is of greater importance than the error itself for 
if the true value becomes larger, then a larger error may be acceptable. If 
the true value diminishes, then the error must also diminish otherwise the 
computed results may be absurd. 


EXAMPLE 10.32 
Does applying Euler’s method to the differential equation 
dy/dx = f(x, y), y(x,) = y,, estimate the total error? 


When f(x, y) =— y, y(0) = 1, compute this error neglecting the round-off 
error. 


Solution: 
We know that Euler’s solution of the given differential equation is 
Yas Y,, 1 hf(x,, y,,) where x, = Xo 7 nh. 
i.€., Gl = Y, ae hy, (1) 
Denoting the exact solution of the given equation at x =x, by y(x,) and 
expanding y(x,,,) by Taylor’s series, we obtain 
h2 
ULaea) = y(x, ) au hy'(x, ) + Ql’ y" (é, ?. Xn = a = Xn aa (2) 
The truncation error T,,, = y(x,,,)-y,,,, = (/2)h? y” (¢,) 


Thus the truncation error is of O(h?) as h > 0. 
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To include the effect of round-off error R,, we introduce a new ap- 
proximation y, which is defined by the same procedure allowing for the 
round-off error. 


Ynt1 = Un +hf (x). ,) —Ryat (3) 
. The total error is defined by 
Bogs = YlXn+1) ~ Yn41 [(2) a (3)] 


= yls,) +hy's,)+ Sy EI, +Hf loth) —Boor} 


_ [yt ) ~ y, | + h [h'( Xi) ~ Ty ? Yn ) + Ti + Rast 
bin: continuity of Of/oy and using Mean-Value theorem, we have 


fix, yl x zy 19g y,) = [y(x,) ia yl fy&,, c , where c, lies between y(x,) 


and y . 


(4) 


*. (4) takes the form 
En+1 _ )-¥,[1 a (x, En )]+ Tu oe Eat 
or E W=E, [1 +hf (x at. Sea 


ntl y Xi C, n+l n+1 


(5) 


This is the recurrence Bee for ae the total error. The first terms 
on the right-hand side is the inherited error, i.e., the propagation of the er- 
ror from the previous step y, to 4 


n+l" 
(b) We have dy/dx = — y, y(0) = 1. 
Taking h = 0.01 and applying (1) successively, we obtain 
y(0.01) =1+0.01(- 1) = 0.99 
y(0.02) = 0.99 + 0.01 (— 0.99) = 0.9801 
y(0.03) = 0.9703, y(0.04) = 0.9606 
. The truncation error 
T= A2)hey(§ ) = 0.00005y§ ) <5 x 10° y(x,) [- dy/dx is — ve] 
ive., T, <5x 10% y(0)=5 x 10° 
T, <5 x 10° y(0.01) =5 x 10° (0.99) < 5 x 10-5 
T, <5 x 10° y(0.02) =5 x 10° (0.9801) < 5 x 10-5 
T, <5 x10° y(0.03) =5 x 10° (0.9703) < 5 x 10-5 ete. 


476 © NumerICAL METHODS IN ENGINEERING AND SCIENCE 


Also 1 + hf,(x,, y,) = 1 + 0.01(- 1) = 0.99. 
Neglecting the round-off error and using the above results, (5) gives 
E, = 0, E, = E0(0.99) + T, <5 x 10° = 0.00005 
E, = E,(0.99) + T, <5 x 10-5 +5 x 10°=0,0001 
E, = E,(0.99) + T, < 10-4+5 x 10% = 0.00015 
E,=E,(0.99) + T, < 1.5 x 10-4+5 x 10% = 0.0002 ete. 
NOTE Obs. The exact solution is y = e~. 
Actual error in y(0.03) = e°® — 0.9703 = 0.00014 


and_ actual error in y(0.04) = e°! — 0.9606 = 0.00019. 
Clearly the total error E,, agrees with the actual error in y(0.04). 


10.14 Convergence of a Method 


Any numerical method for solving a differential equation is said to be 
convergent if the approximate solution y, approaches the exact solution 
y(x,) as h tends to zero provided the rounding errors arise from the initial 
conditions approach zero. This means that as a method is continually re- 
fined by taking smaller and smaller step-sizes, the sequence of approximate 
solutions must converge to the exact solution. 


Taylor's series method is convergent provided f(x, y) possesses enough 
continuous derivatives. The Runge-Kutta methods are also convergent un- 
der similar conditions. Predictor corrector methods are convergent if f(x, y) 
satisfies the Lipschitz condition, i.e., 


| flay) — flog) Ie Rly J 
k being a constant, then the sequence of approximations to the numeri- 
cal solution converges to the exact solution. 


> 


10.15 Stability Analysis 


There is a limit to which the step-size h can be reduced for controlling 
the truncation error, beyond which a further reduction in h will result in 
the increase of round-off error and hence increase in the total error. This 
behavior of the error bound is shown in Figure 10.3. 


In such situations, we have to use stable methods so that an error intro- 
duced at any stage does not get magnified. 


Error 
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A method is said to be stable if it produces a bounded solution which 
imitates the exact solution. Otherwise it is said to be unstable. If a method 
is stable for all values of the parameter, it is said to be absolutely or uncon- 
ditionally stable. If it is stable for some values of the parameter, it is said to 
be conditionally stable. 


The Taylor’s method and Adams-Bashforth method prove to be rela- 
tively stable. Euler’s method and the Runge-Kutta method are condition- 
ally stable as will be seen from Example 10.23. 


The Milne’s method is however, unstable since when the parameter is 
negative, each of the errors is magnified while the exact solution decays. 


A 


Round-off error 


Optimum, h 


FIGURE 10.3 


EXAMPLE 10.33 


Does applying Euler’s method to the equation 
dy/dx = Ay, given y(x,) =Yy 


determine its stability zone? What would be the range of stability when 
A=-1? 


Solution: 
We have y’ =Ay, y(x,) =Y, (1) 
By Euler’s method, 


Y, = Yi ale hy’ = Yn + Ahy,,_, = e! x Ah)y,._, [by (1) 
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y, ,=(1+ah)y,, 


n-1 


y,=(1 +h) y, 
y,=(1+dh) y, 
Multiplying all these equations, we obtain 
Y, = (1 + Ah)" Yo (2) 


Integrating (1), we get y = ce™ 


Using y(x,) =y, y, = ce” ~y=yer™ 
In particular, the exact solution nee (x,, y,,) is 
y, = err x0) = ye [-: Pet nh] 
5 2 n 
or Yn = yy(e \r = Yo frie qe es, a (3) 
Unstable AL, (Ah) 
Stable 
> 
-2 = R (ah) 
FIGURE 10.4 


Clearly the numerical solution (2) agrees with exact solution (3) for 
small values of h. The solution (2) increases if |1 +Ah| > 1. 


Hence |1 + Ah|< 1 defines a stable zone. 
When A is real, then the method is stable if |1 + Ah| < Lie. -2<Ah <0 
When A is complex (=a + ib), then it is stable if 
ll +(a+ib)h|< lie. (1+ah)?+ (bh)? <1 
12, er l2+y, <1, [where x = ah, y =bh.] 


i.e., Ah lies within the unit circle shown in Figure 10.4. 


When d is imaginary (=ib), | = 1, then we have a periodic-stability. 
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Hence Euler’s method is absolutely stable if and only if 
(i) realdA: —2 <Ah=0. 


(ii) complex A: Ah lies within the unit circle (Figure 10.4), i.e., Euler’s 
method is conditionally convergent. 


When A = — 1, the solution is stable in the range - 2 < —h < 0 
ie. 0<h <2. 


Exercises 10.7 


1. Show that the approximate values y,, obtained from y’ = y with y(0) = 1 
by Taylor's series method, converge to the exact solution for h tending to 
ZeYO. 


2. Show that the modified Euler’s method is convergent. 


3. Starting with the equation y’ =Ay, show that the modified Euler’s 
method is relatively stable. 


4. Apply the fourth order Runge-Kutta method to the equation dy/dx = py, 
y(x,) =y, and show that the range of absolute stability is 
—2.78 < uh <0. 
5. Find the range of absolute stability of the equation 
y’ + 10y = 0, y(0) = 1, using 
(a) Euler’s method, (b) Runge-Kutta method. 
6. Show that the local truncation errors in the Milne’s predictor and cor- 


rector formulae are 


u 


14 1, 
grey and “ogo , respectively. 


10.16 Boundary Value Problems 


Such a problem requires the solution of a differential equation in a 
region R subject to the various conditions on the boundary of R. Practical 
applications give rise to many such problems. We shall discuss two-point 
linear boundary value problems of the following types: 

ey 
i 
) dx” 


d 
+ Ux) + u(x)y =y(x) with the conditions y(x,) =a, 
Ae 
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‘, 
(ii) ot —+A(x)y = u(x) with the conditions y(x,) = y’(x,) =a and 
y(x,) = y'(x,) = b. 


There exist two numerical methods for solving such boundary value 
problems. The first one is known as the finite difference method which 
makes use of finite difference equivalents of derivatives. The second one is 
called the shooting method which makes use of the techniques for solving 
initial value problems. 


10.17 Finite-Difference Method 


In this method, the derivatives appearing in the differential equation 
and the boundary conditions are replaced by their finite-difference ap- 
proximations and the resulting linear system of equations are solved by any 
standard procedure. These roots are the values of the required solution at 
the pivotal points. 


The finite-difference approximations to the various derivatives are 
derived as under: 

If y(x) and its derivatives are single-valued continuous functions of x 
then by Taylor’s expansion, we have 


y(xth)= y(s) +hy'(a) +2 ys) eh py'G@)+- (1) 


and y(x—h)= yls)+hy (a) +2 yn) + yn) (2) 
Equation (1) gives , 


yo) =2[ye+h)-y@)]- gy) 


i.€., 0) =F Lyle +h) y)] +00) 
which is the forward difference approximation of y’(x) with an error of the 
order h. 

Similarly (2) gives 


y' (x)= Lys) —y(x-h)]+O(h) 
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which is the backward difference approximation of y’(x) with an error of 
the order h. 


Subtracting (2) from (1), we obtain 


y (x)= syle +h)—ylx-W)] +00" 


which is the central-difference approximation of y’(x) with an error of the 
order h?. Clearly this central difference pecseor ha to y’(x) is better than 
the forward or backward difference approximations and hence should be 
preferred. 


Adding (1) and (2), we get 
y" (x d= salle th) -2y Qy(x) + y(x ~h)|+O(h’) 


which is the central difference approximation of y”(x). Similarly we can de- 
rive central difference approximations to higher derivatives. 


Hence the working expressions for the central difference approxima- 
tions to the first four derivatives of y, are as under: 


, 1 
Yi = 5p Yer — Yi) 
y= cris —2y, + 4-1) e 
m 1 
y= —s(yirs = 24:41 +2y.1- 4-2) (5 
2h 
oO 
y= i (iss — 4y,4, + 6y, —4y,_) +4 2) i 


NOTE Obs. The accuracy of this method depends on the size of the 
sub-interval h and also on the order of approximation. As we 
reduce h, the accuracy improves but the number of equations to 
be solved also increases. 


EXAMPLE 10.34 


Solve the equation y” = x + y with the boundary conditions y(0) = 
y(1) =0. 
Solution: 


We divide the interval (0, 1) into four sub-intervals so that h = 1/4 and 
the pivot points are at x, =0, x, = 1/4, x, = 1/2, x, = 3/4, andx,= 1. 
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Then the differential equation is approximated as 
ae —2y; + yi ]=2; + y; 

or 16y,,, — 33y,+ 16, , =x, i= 1, 2, 3. 

Using y, = y, = 0, we get the system of equations 

16y, —33y, = 716 y, —33y +16y, = si 33y3 + 16y, =— 

Their solution gives 


y, =— 9.03488, y, = — 0.05632, y, = — 0.05003. 
sinhx 


sinh 1 
each nodal point is given in the table below: 


NOTE. Obs. The exact solution being y(x)= 


—x, the error at 


x Computed value y(x) Exact value y(x) Error 
0.25 — 0.03488 — 0.03505 0.00017 
0.5 — 0.05632 — 0.05659 0.00027 
0.75 — 0.05003 — 0.05028 0.00025 


EXAMPLE 10.35 
Using the finite difference method, find y(0.25), y(0.5), and y(0.75) sat- 


isfying the differential equation e eee) +y =x, subject to the boundary condi- 
tions y(0) = 0, y(1) =2 dx” 


Solution: 


Dividing the interval (0, 1) into four sub-intervals so that h = 0.25 and 
the pivot points are at x, = 0, x, = 0.25, x, = 0.5, x, = 0.75, andx,=1. 


The given one y"(x) + y(x) =x, is approximated as 


alin -2 yi tyia|+y, =; 


or on —3ly,+ 16y,, =x, (i 
Using y,=0 and y, = 2, (i) gives ae system of equation, 
(i= 1) 16y, —3ly, = 0.5. (ii 
(i = 2) 16y, —3ly, + 16y, =0.5 (iti 


(i= 3) 32-3ly, + 16y, = 0.75, ie., — 3ly, + 16y, =— 31.25 (iv 
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Solving the equations (ii), (iii), and (iv), we get 
y, = 0.5443, y, = 1.0701, y, = 1.5604 
Hence y (0.25) = 0.5443, y(0.5) = 1.0701, y(0.75) = 1.5604 


EXAMPLE 10.36 


Determine values of y at the pivotal points of the interval (0, 1) if y 
satisfies the boundary value problem y’’ + 81ly = 81x”, y(0) = y(1) =y”(0) = 
y” (1) =0. (Take n = 3). 


Solution: 

Here h = 1/3 and the pivotal points are x, = 0, x, = 1/3, x, = 2/3, x, = 1. 
The corresponding y-values are y,(=0), y,, y,, Y3(= 9). 

Replacing y” by its central difference approximation, the differential 
equation becomes 


1 P 
i (Vive — Ayia +6y; —4y.4 +4 a) + 8ly, = 81x; 
a Ying — 4y,., + Ty, ~ 4y, TY, 9= Xs i=1,2 
At i=1,y,-—4y,+ Ty,-4y,t+y-1l=1/9 
At t= 2. yoy ty, 4g ya 


Using y, = y, = 0, we get — 4y, + Ty, + y-1 = 1/9 (i) 
y,t Ty, —4y, = 4/9 (ii) 


Regarding the conditions y,” = y,” = 0, we know that 


a” 1 
yi =F 5 Yin —2y, + y;4) 


Ati=0, yg =9(y,— 24 t yl) or y-L=—y, Dv yg = Yo" = 
Ati=3, ys = 9y,—2y, +y,) Ory,=— Yo [. Y= 3 = ] (iv 
Using (iii), the equation (i) becomes 


— 4y, + 6y, = 1/9 (ov 
Using (iv), the equation (ii) reduces to 
6y, — 4y, = 4/9 (vi 


Solving (v) and (vi), we obtain 
y, = 11/90 and y, = 7/45. 


Hence y(1/3) = 0.1222 and y(2/3) = 0.1556. 
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EXAMPLE 10.37 : 


d°t 
The deflection of a beam is governed by the equation ae! +81ly = G(x), 
where f(x) is given by the table dx* 


x 1/3 2/3 1 
p(x) 81 162 943 
and boundary condition y(0) = y’(0) = y”(1) = y”’(1) = 0. Evaluate the de- 
flection at the pivotal points of the beam using three sub-intervals. 


Solution: 


Here h = 1/3 and the pivotal points are x, x, = 1/8, x, = 2/3, x3 = 1, 
The corresponding y-values are y,(= 9), y,, y5, Yor 


The given differential equation is approximated to 


Gas — 4yi41 + 6y, —4y,1 + Yio) + Sly; = (x) 


ht 
Ati=1,y,-4y,+ 7y,-—4y,+y-l=1 (i) 
Ati=2, y,-—4y,+7y,-4y,+y,=2 (ii) 
Ati=3, y,—4y,+7y,-4y,+y,=3 (iti) 
We have Y= (iv) 
Since yi = oh Ga yia) 
aie fori =0, (0) = YW =(u1 -y-l)ie, y-l=y, (v) 
Since yi" = a (Yee — 2y,+1 4) 
“ fori =3, 0=y5 ==(y, = 2ys + yp) ,ies Yu = 2ys ~ Yo (vi) 
m 1 
Also y= ae irs = 2yj41) + 2y; -y.2) 


1 
«. for i= 3, 0 =y3= ne —(ys —2y4 +249 — in) 


Leé., y,=2y,-2y,+y, (vii) 
Using (iv) and (v), the equation (i) reduces to 


Y3- 4y, ea 8y, = (viii) 
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Using (iv) and (vi), the equation (ii) becomes 


—y, + 8y,—2y,=1 (ix) 
Using (vi) and (vii), the equation (iii) reduces to 
3y, —4y, + 2y,=3 (x) 


Solving (viii), (ix), and (x), we get 
y, = 8/13, y, = 22/13, y, = 37/13. 
Hence y(1/3) = 0.6154, y(2/3) = 1.6923, y(1) = 2.8462. 


10.18 Shooting Method 


In this method, the given boundary value problem is first transformed 
to an initial value problem. Then this initial value problem is solved by Tay- 
lor’s series method or Runge-Kutta method, etc. Finally the given bound- 
ary value problem is solved. The approach in this method is quite simple. 

Consider the boundary value problem 


y"(x) =y(x), yx) =A, y(b) =B (1) 

One condition is y(a) = A and let us assume that y’(a) = m which rep- 
resents the slope. We start with two initial guesses for m, then find the cor- 
responding value of y(b) using any initial value method. 

Let the two guesses be m,, m, so that the corresponding values of y(b) 
are y(m,, b) and y(m.,, b). Assuming that the values of m and y(b) are lin- 
early related, we obtain a better approximation m, for m from the relation: 

Ms —M, mM, —M> 


y(b)—y(m,b) — y(m,,b)= y(m,b) 
y(m b) yb) 
y(m,,b) y(mp,b) 


We now solve the initial value problem 


This gives my =m, —(m,—m)) 


y"(x) = y(x), yla) =A, y“(a) =m, 
and obtain the solution y(m,, b). 


To obtain a better approximation m, for m, we again use the linear rela- 
tion (2) with [m,, y(m,, b)] and [m,, y(m,, b)]. This process is repeated until 
the value of y(m,, b) agrees with y(b) to desired accuracy. 
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y(x) Ailes 
y(a) =m,)' 
A g “' B= y(m,,b) 
i) 
I 
eee s= 1 B, = y(m,b) 
I 
| B=y(b) 
1 
1 
1 
1B, =y(m,,b) 
A 
1 I 
1 I 
1 I 
1 I 
1 I 
| | | >X 
0 d 
xX, =a %; x x5 x,=b 
FIGURE 10.5 


NOTE Obs. This method resembles an artillery problem and as such 
is called the shooting method (Figure 10.5). The speed of 
convergence in this method depends on our initial choice of 
two guesses form. However, the shooting method is quite slow 
in practice. Also this method is quite tedius to apply to higher 
order boundary value problems. 


EXAMPLE 10.38 
Using the shooting method, solve the boundary value problem: 
y” (x) = y(x), y(O) =0 and y(1) = 1.17. 
Solution: 


Let the initial guesses for y’(0) = m be m, = 0.8 and m, = 0.9. 
Then y”(x) = y(x), y(0) = 0 gives 


y’(0)=m y”(0) = y(0) =0 
y(0) =y(0) =m, yr(0)=y"(0) =0 
yvo(0) =y”"(0) =m, yvi(0) = yiv(0) = 0 


and so on. 
Putting these values in the Taylor’s series, we have 


2 3 
ylx)= y(0) + xy' (0) + y"(0) + Fy"(0) + 
3 5 7 
C x x 

+ + + 
6 120 5040 


=mixt 
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y(1) = m(1 + 0.1667 + 0.0083 + 0.0002 + ---) =m (1.175) 
For m, = 0.8, y(m,, 1) = 0.8 x 1.175 = 0.94 
For m, = 0.9, y(m,, 1) = 0.9 x 1.175 = 1.057 
Hence a better approximation for m, i.e., m, is given by 
y(m,1)- yQ) 
y(m,1)- y(mp,1) 


1.057 — 1.175 
= 0.9- (0.1) ———- = 0.9 + 0.10085 = 1.00085 
1.057 — 0.94 


which is closer to the exact value of y’(0) = 0.996 


Ms = My, —(m, — my) 


We now solve the initial value problem 
y"(x) = y(x), y(O) =0, y’(0) =m,. 
Taylor's series solution is given by 
y(m,, 1) =m, (1.175) = 1.1759 


Hence the solution at x = 1 is y = 1.176 which is close to the exact value 
of y(1) = 1.17. 


Exercises 10.8 


1. Solve the boundary value problem for x = 0.5: 


9 


AY 
2. Find an approximate solution of the boundary value problem: 
y” + 8(sin? zy) y=0,0<x <1, y(0)=y(1)=1. (Take n = 4) 


3. Solve the boundary value problem: 

ay” + y =0, y(1) = 1, y(2) =2. (Take n = 4) 
4. Solve the equation y” — 4y’ + 4y = e*, with the conditions y(0) = 0, 

y(1) =- 2, taking n = 4. 


5. Solve the boundary value problem y” — 64y + 10 = 0 with y(0) = y(1) =0 
by the finite difference method. Compute the value of y(0.5) and com- 
pare with the true value. 
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6. Solve the boundary value problem 
y” + xy’ + y = 8x? + 2, y(0) = 0, y(1) = 1. 
7. The boundary value problem governing the deflection of a beam of 
length three meters is given by 

d*y Lee 

SF 4 oy = =x? +=x44,y(0)=y'(0)=y(3)=y'(3) =0. 
The beam is built-in at the left end (x = 0) and simply supported at the 
right end (x = 3). 
Determine y at the pivotal points x = 1 and x = 2. 


8. Solve the boundary value problem, 


d‘ 
i +8ly= 729x"y(0) = y'(0) = y"(1) a y"(1) =0. Usen=3 
Es 
9. Solve the equation y” — y” + y =x”, subject to the boundary conditions 
y(0) =y’(0) = 0 and y(1) = 2, y’(1) =0. (Take n =5). 


10. Apply shooting method to solve the boundary value problem 


a 
7 =y, y(0)=0 and y(1)=1.1752. 
11. Using shooting method, solve the boundary value problem 
2 
Oe 6y?, y(0) =1, y(0.5) = 0.44 
dx2 


10.19 Objective Type of Questions 


Exercises 10.9 


Select the correct answer or fill up the blanks in the following questions: 


1. Which of the following is a step by step method: 
(a) Taylor's (b) Adams-Bashforth 
(c) Picard’s (d) None. 
2. The finite difference scheme for the equation 2y” + y =5is ....... 


3. Ify’=x+y, y(0)=1landy™ = 1+ + x°/2, then by Picard’s method, the 
value of y?(x) is ...... 
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. The iterative formula of Euler’s method for solving y’ = f(x, y) with 


Y(Xq) = Yop 1S sree ; 


. Taylor's series for solution of first order ordinary differential equations 


IS ve... . 


. The disadvantage of Picard’s method is ...... . 


. Given Y,, Y|, Ys, Ys Milne’s corrector formula to find y, for dy/dx = 


PEAS cen ; 


. The second order Runge-Kutta formula is ...... . 


9. Adams-Bashforth predictor formula to solve y’ =f(x, y), given y, = y(x,) 


10. 


11. 


12. 
13. 


14. 
15. 
16. 


17. 


18. 
19. 


20. 


21. 


IS saa 


The Runge-Kutta method is better than Taylor’s series method because 


To predict Adam’s method atleast ...... values of y, prior to the desired 
value, are required. 


Taylor's series solution of y’ — xy = 0, y(0) = 1 upto x* is ...... : 


If dy/dx is a function of x alone, the fourth order Runge-Kutta method 
reduces to ....... 


Milne’s Predictor formula is ....... 

Adam’s Corrector formula is ....... 

Using Euler’s method, dy/dx = (y — 2x)/y, y(0) = 1; gives y (0.1) =..... ‘ 
d’y | ody 


+y° —+y=0 is equivalent to a set of two first order differential 


dx” dx 


equations ...... and... . 


The formula for the fourth order Runge-Kutta method is ...... . 


Taylor's series method will be useful to give some ...... of Milne’s 
method. 

The names of two self-starting methods to solve y’ = f(x, y) given 
y(x,) =y, are ...... : 


In the derivation of the fourth order Runge-Kutta formula, it is called 
fourth order because ..... 
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22. 


23. 
24. 


25. 


26. 


27. 


28. 


29. 


30. 


31. 


32. 
33. 


If y’ =x—y, y(0) = 1 then by Picard’s method, the value of y" (1) is ...... . 
(a) 0.915 (b) 0.905 (c) 1.091 (d) none. 


The finite difference formulae for y’(x) and y”(x) are ...... ; 


If y’ =—y, y(0) = 1, then by Euler’s method, the value of y(1) is 
(a) 0.99 (b) 0.999 (c) 0.981 (d) none. 


Write down the difference between initial value problem and boundary 
value problem ..... . 


Which of the following methods is the best for solving initial value prob- 
lems: 

(a) Taylor’s series method 

(b) Euler’s method 

(c) Runge-Kutta method of the fourth order 

(d) Modified Euler’s method. 


The finite difference scheme of the differential equation y” + 2y = 0 is 


Using the modified Euler’s method, the value of y(0.1) for 


d 
“Fy —y.y(0)=1 1S 


dx 
(a) 0.809 (b) 0.909 (c) 0.0809 (c) none. 
The multi-step methods available for solving ordinary differential equa- 


tions are ...... ; 


Using the Runge Kutta method, the value of y(0.1) for y’ =x — 2y, y(0) = 
1, taking h = 0.1, is ...... 
(a) 0.813 (b) 0.825 (c) 0.0825 (c) none. 


In Euler’s method, ifh is small the method is too slow, if h is large, it 
gives inaccurate value. (True or False) 

Runge-Kutta method is a self-starting method. (True or False) 
Predictor-corrector methods are self-starting methods. (True or False) 


CHAPTER | | 


NUMERICAL SOLUTION OF 
PARTIAL DIFFERENTIAL EQUATIONS 


Chapter Objectives 


Introduction 

Classification of second order equations 
Finite-difference approximations 

Elliptic equations to partial derivatives 
Solution of Laplace equation 

Solution of Poisson’s equation 

Solution of elliptic equations by relaxation 
Parabolic equations method 

Solution of one-dimensional heat equation 
Solution of two-dimensional heat equation 
Hyperbolic equations 


Solution of wave equation 


11.1. Introduction 


Partial differential equations arise in the study of many branches 
of applied mathematics, e.g., in fluid dynamics, heat transfer, 
boundary layer flow, elasticity, quantum mechanics, and electro- 
magnetic theory. Only a few of these equations can be solved by 
analytical methods which are also complicated by requiring use of 
advanced mathematical techniques. In most of the cases, it is easier 
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to develop approximate solutions by numerical methods. Of all the numeri- 
cal methods available for the solution of partial differential equations, the 
method of finite differences is most commonly used. In this method, the 
derivatives appearing in the equation and the boundary conditions are re- 
placed by their finite difference approximations. Then the given equation 
is changed to a system of linear equations which are solved by iterative pro- 
cedures. This process is slow but produces good results in many boundary 
value problems. An added advantage of this method is that the computation 
can be carried by electronic computers. To accelerate the solution, some- 
times the method of relaxation proves quite effective. 


Besides discussing the finite difference method, we shall briefly de- 
scribe the relaxation method also in this chapter. 


11.2 Classification of Second Order Equations 


The general linear partial differential equation of the second order in 
two independent variables is of the form 


ie) ey) 2 ee) eel Ow 
aseamies —— u—.— |= 

YT Gd . dxdy . ay” oe dx’ dy 

Such a partial differential equation is said to be 


(i) elliptic if B?- 4AC < 0, (ii) parabolic if B’? — 4AC = 0, and 
(iii) hyperbolic if B? — 4AC > 0. 


NOTE Obs. A partial equation is classified according to the region 

in which it is desired to be solved. For instance, the partial 
differential equation f., + f,, = 0 is elliptic if y > 0, parabolic if y 
= 0, and hyperbolic if y < 0. 


EXAMPLE 11.1 


Classify the following equations: 


d au au au du Ou 
(i) 23 27, +! 
ox oxdy dy Ox oy 


a, 2, 
(ii) eg Hig) 0 -O =e ea <7] 
x y 
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Gi (Ite) E+ (5428) =" 4 (44) <0 
© axe * / axat de Pie 


Solution: 
(i) Comparing this equation with (1) above, we find that t? 
A=1,B=4,C=4 
B?—4AC =(4)?-4x1x4=0 
So the equation is parabolic. 
(ii) Here A=x°, B=0,C =1-y? 
B?— 4AC =0 — 4x? (1 —y?) = 402(y?— 1) 


For all x between — © and ©, x? is positive 


For all y between — | and 1, y? < 1 
B?—4AC <0 
Hence the equation is elliptic 
(iii) Here A = 14+2?,B=5+4 2x7 C=442x 
B?—4AC = (5 + 2x7)? —4(1 + x7)(4 +42) =9i.e. > 0 
So the equation is hyperbolic 


Exercises 11.1 


1. What is the classification of the equation f+ 2f, +f, =0. 


xy yy 
2. Determine whether the following equation is elliptic or hyperbolic? 
(x + L)u_, —2(x + 2)u,, +(x+3)u =0. 


UL 
yy 
3. Classify the equation 
\ nO 2 2p 
(i) yu, 2xyu,, +, + 2u,— 3u = 0. 


2 au 2 au _ Ou ou 


+s + =» = 
(ii) x axe y ay? ae y 


oy 
a at eu du. a 
(ii) 344 — a ae 
Ox” dxdy dy ox dy 
4. In which parts of the (x, y) plane is the following equation elliptic? 


fu, &u +{ 2g ayo Qi ( ) 
ae x = 2sin(xy). 
ax” dxdy : ay” 


-—u=0 
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11.3 Finite Difference Approximations to Partial Derivatives 


Consider a rectangular region R in the x, y plane. Divide this region 
into a rectangular network of sides Av = h and Ay = k as shown in Figure 
11.1. The points of intersection of the dividing lines are called mesh points, 
nodal points, or grid points 


Y 
R 
(xy +k) 
(@j+1) 
x—h, x, x+h, 
i? uy) 4 Ge Na La 
G-1L{) (i,j) (i+ 1,j) 
(wy-k) 
2 7-1) 
r 
= 
— 
q (Ax = h) XxX 
FIGURE11.1 


Then we have the finite difference approximations for the partial de- 
rivatives in x-direction (Section 10.17): 


du u(x th,y)—u(x,y) 


_ u(x,y)— u(x —h,y) 


+O(h +O(h 
a h (h) i (h) 
7 uxthy)—ulx=h,y) +0h? 
2h 
ua (x—h,y) —2u(x,y) + ulx + 2 
And i) 2 (x—h,y) oH! u(x +h,y) +0(h?) 
ax h 
Writing u(x, y) = u(ih, jk) as simply Us, p the above approximations be- 
come 
Usa J—-U; ; 
ux = etd as (1) 
h 
u;,;—-U_1.J 
= + 0(h) (2) 


h 
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Uist a 
= ee ON) (3) 
Uj, ~2U;; FUj 4; 
Uy, = Lj a +L] 4 Oth?) (4) 
Similarly we have the approximations for the derivatives w.r.t. y: 
y PP U] 
Uj j4a 7 Uj 
= —4+—++0(k 
Uy 7 (k) 6s 
Uji Uj j-1 
= J : J he O(k) (6 
u,,+1—-—u,,-1 
aa m7 1+ O(k*) G 
Uj, jy — 2; FU; p41 é 
and Uy =— eo + O(k") (8 


Replacing the derivatives in any partial differential equation by their cor- 
responding difference approximations (1) to (8), we obtain the finite-differ- 
ence analogues of the given equation. 


11.4 Elliptic Equations 


2 2 
The Laplace equation V7u = a4 u a = 


0 and the Poisson’s equation 
ox” Oy” 


udu 
ae ae = f(x,y) are Example s of elliptic partial differential equations. 
x dy 
The Laplace equation arises in steady-state flow and potential problems. 
Poisson’s equation arises in fluid mechanics, electricity and magnetism and 
torsion problems. 


. . ae 
The solution of these equations is 
a function u(x, y) which is satisfied at Beundaniceaditions 
every point of a region R subject to cer- prescribed 
tain boundary conditions specified on Closed preach 
: : point of C 
the closed curve C (Figure 11.2). region (aliaded) 


R 


In general, problems concerning 
steady viscous flow, equilibrium stress- 
es in elastic structures etc., lead to el- 4 >X 
liptic type of equations. FIGURE 11.2 
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11.5 Solution of Laplace’s Equation 


2, 4 


Consider a rectangular region R for which u(x, y) is known at the bound- 
ary. Divide this region into a network of square mesh of side h, as shown in 
Figure 11.3 (assuming that an exact sub-division of R is possible). Replacing 
the derivatives in (1) by their difference approximations, we have 

1 


1 
rae _ 2u; + tis | + [uj = 2ui,j + ei =0 


1 
or uj = zie + ig FU ya + wi j-1| (2) 


Dx Des b,. bes 


ee 


b.. 
5,3 


Bis 


b b b b b 


> 
11 2,1 3,1 4,1 5,1 X 


FIGURE 11.3 


This shows that the value of wu at any interior mesh point is the aver- 
age of its values at four neighboring points to the left, right, above and 
below. (2) is called the standard 5-point formula which is exhibited in 
Figure 11.4. 


Sometimes a formula similar to (2) is used which is given by 
uj = q tics Fit ja F ia ja Uj—1,j-1) (3) 


This shows that the value of u, , is the average of its values at the four 
neighboring diagonal mesh points. (3) is called the diagonal five-point 
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formula which is represented in Figure 11.5. Although (3) is less accurate 


than (2), yet it serves as a reasonably good approximation for obtaining the 
starting values at the mesh points. 


u U.., 
i jel Ui ish jel 
= S 
\ Z 
\ y, 
y 
N 
4 - 
\ rd 
\ 4 
\ 4 
% Fi 
@ 
. bf Ta fy 
Uy ij teh y me 
¢ \ 
f aN 
ro 
N 
y f \ 
is > 
u 
ans U., 
Word il j-l i+L jl 
FIGURE 11.4 FIGURE 11.5 


Now to find the initial values of wu at the interior mesh points, we first 
use the diagonal five-point formula (3) and compute u,, ,,u, ,,U, ,U,, and 


87.37 24? 4 Ara D 
u, ,, in this order. Thus we get, 


u, =~ (b, +b, +b, ,+, 
4 
=! b, +b 
i 5 TU, 3 35 ¢ ‘eal 
1 
ga eget Big Oy th git 
4 
1 
=— (u, Os ed, (tb, ay 
4 
1 
Uy. = 7 (P.3 Ds gO) 
The values at the remaining interior points, i.¢., u, ,, U, , U es and w, , are 


computed by the standard five-point formula (2). Thus, we obtain 


1 
ths = a ate g Pty), Us 4 
aa tu, +b,.+u,.) 
4 2,4 4,4 3,5 Be: 
u wily +b,,+u,,+u,.,),u 
43 4 ty 3 BB) A, A WA QE 3.9. 
1 
— 7 tas Tyg tty 9+ u,,) 
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Having found all the nine values of u, , once, their accuracy is improved 
by either of the following iterative methods. In each case, the method is 
repeated until the difference between two consecutive iterates becomes 
an 

(i) Jacobi’s method. Denoting the nth iterative value of u, ,, by u'" 
the iterative formula to solve (2) is 


1 
(ntl) (n (n (n (n) 
airy = [u gt haa a ical (4) 


It gives improved values of u, , at the interior mesh points and is 
called the point Jacobi °s formula. 


(ii) Gauss-Seidal method. In this method, the iteration formula is 


1 
(ntl) (n+1) (n) (n+1) (n) 
ue = Fi [u gh wg te aga egal 


It utilizes the latest iterative value available and scans the mesh points sym- 
metrically from left to right along successive rows. 


NOTE Obs. The Gauss-Seidal method is simple and can be adapted to 

———___ computer calculations. Its convergence being slow, the working 
is somewhat lengthy. It can however, be shown that the Gauss- 
Seidal scheme converges twice as fast as Jacobi’s scheme. 


The accuracy of calculations depends on the mesh-size, i.e., smaller the h, 
the better the accuracy. But if h is too small, it may increase rounding-off 
errors and also increases the labor of computation. 


EXAMPLE 11.2 


Solve the elliptic equation wu. + Uy, = 0 for the following square mesh 
with boundary values as shown in Figure 11.6. 


Solution: 


Let u,,u,,-++, u, be the values of u at the interior mesh-points. Since the 
boundary values of wu are symmetrical about AB, 


- U, =U,, Us =U,, Uy = Uy. 
Also the values of u being symmetrical about CD. u3 = u,, u, = u, 


Uy = Uu.. 


Thus it is sufficient to find the values w,, u,, u,, and u,. 
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0 500 1000 500 0 
Cc 

uy u, Us 

1000 = 1000 
U, u. Ug B 

2000 ‘ 2000 
u Us Uy 

1000 1000 

D 
y 500 1000 500 
FIGURE 11.6 


Now we find their initial values in the following order: 


u,= - (2000 + 2000 + 1000 + 1000) = 1500 (Std. formula 
= N= (0 + 1500 + 1000 + 2000) = 1125 (Diag.formula 
j= (1125 + 1125 + 1000 + 1500) = 1188 (Std. formula 
u,= : 14 (2000 + 1500 + 1125 + 1125) +1438 (Std. formula 


Now we carry out the iteration process using the standard formulae: 


ul N= [1000 + uf + 500 +u{” | 


1 
ug) = Pur + ul 410004 ul] 
4 


2 


yet) — [2000 tu) + ul? tual” 


(n+1) (n i 


1 
ug*? = [uf (n+1) py” +ul +ul 
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First iteration: (put n = 0 in the above results) 
1 
in = 4 (2000 +1188 +500 + 1438) = 1032 
1 
ul) = (1032 +1125 + 1000 + 1500) = 1164 
(2000 + 1500 + 1032 + 1125) = 1414 


1 
ug) = q(l4l4 +1438 + 1164 + 1188) = 1301 


Second iteration: (put n = 1) 


Pa 
a?) = 7 (1000 +1164 +500 + 1414) = 1020 
1 
ue = (1020 + 1032 + 1000 + 1301) = 1088 
a) _1/, : a 
u? = 7 (2000 + 1301+ 1020 + 1032) = 1338 
1 
ue = 7 (1338 + 14144 1088 + 1164) = 1251 


Third iteration: 


1 
au) = (1000 + 1088 + 500 + 1338) = 982 
1 
u?) = 3 (982 + 1020 + 1000 + 1251) = 1063 
eB 
ue = 7 (2000 +1251 +982 + 1020) = 1313 


1 
c= 731s + 1338 + 1063 + 1088) = 1201 


Fourth iteration: 


1 
ul!) = 7 (1000 + 1063 + 500 + 1313) = 969 


1 
us) = 7 (969 + 982 + 1000 + 1201) = 1038 


NUMERICAL SOLUTION OF PARTIAL DIFFERENTIAL EQUATIONS ¢ 501 


rae | 
a? = (2000 +1201 +969 + 982) = 1288 


1 
ul) = (1288 +1313 + 1038 + 1063) = 1176 
Fifth iteration: 
ee | 
“= 7 (1000 + 1038 + 500 + 1288) = 957 


1 
uf) = 7 (957 +969 + 1000 + 1176) = 1026 


1 
u) = (2000 +1176 + 957 + 969) = 1276 


w= ~(1276 + 1288 + 1026 + 1038) = 1157 
Similarly, 

ul) =951, us =1016,u = 1266, ul) = 1146 
ul = 946,u%? =1011, ui =1260, uh” = 1138 
ul’) = 943, uf) = 1007, u8) = 1257, u8) = 1134 
u = 941, ul = 1005,u = 1255, u9) =1131 
ul = 940, u2 = 1003, uf = 1953, uf = 1129 
uo) _ 939, us!) — 1002, uv? = 1252, u0 = 1128 


ull) = 930, u$)) = 1001, 9 ~ 1251, ul” = 1126 


There is a negligible difference between the values obtained in the elev- 
enth and twelfth iterations. 


Hence wu, = 939, u, = 1001, u, = 1251 and u, = 1126. 


EXAMPLE 11.3 


Given the values of u(x, y) on the boundary of the square in the Figure 
11.7, evaluate the function u(x, y) satisfying the Laplace equation V7u = 0 
at the pivotal points of this figure by 


(a) Jacobi’s method (b) Gauss-Seidal method 
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Solution: 


To get the initial values of u,, u,, u,, u, we assume that u, = 0. Then 


u,= - (1000 + 0 + 1000 + 2000) = 1000 
u,= . (1000 + 500 + 1000 + 0) = 625 
u,= - (2000 + 0 + 1000 + 500) = 875 
u,= = (875-+0 +625 +0 = 375 
1000 1000 1000 1000 
u, u, 
2000 a 500 
u. u 
2000 : s 0 
1000 500 0 0 
FIGURE 11.7 


(Diag. formula 
(Std. formula 
(Std. formula 


(Std. formula 


(a) We carry out the successive iterations, using Jacobi’s formulae: 


yirt 1) = [ 2000 of ul” + 1000 + us | 


1 
4 
(n+1) 


1 n n 
Uy = sl +500 +1000 + uv! 4 


1 
ut) = L200 +ul + ul” +500 | 


1 
yer) = ales” +04ul? + o| 


First iteration: (put n = 0 in the above results) 


1 
“= 7 (2000 + 625 + 1000 + 875) = 1125 
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1 
uy) = = (1000 +500 + 1000 + 375) = 719 
1 
= 7 (2000 +375 + 1000 +500) = 969 


= (875 +0 + 625+0)~375 


Second iteration: (put n = 1) 


1 
u? = = 7 (2000 +719 + 1000 + 969) = 1172 
1 
= qtil2s +500 + 1000 + 375) = 750 
2) = (2000 + 375 +1125 +500) = 1000 


1 
- = 7 (969 +0 +719 + 0) = 422 


Similarly, uj” = 1188,u;) = 774,uS) = 1024,u'?) = 438 
= 1200,us? = 782,u%" = 1032, u\% = 450 
ul?) = 1204,u9) = 788,u$) = 1038,u' = 454 
u\®) = 1206.5, i = 790,uS) = 1040,u\? = 456.5 
u\” = 1208,uS” = 791uY) = 1041,u\” = 458 
and ul) = 1208, us =791.5,u = 1041.5,u\ = 458 . 


There is no significant difference between the seventh and eighth itera- 
tion values. 


Hence wu, = 1208, u, = 792, u, = 1042 and u, = 458. 


(b) We carry out the successive iterations, using Gauss-Seidal formulae 


1 
wrth) = _. + us”) +1000 + ul | 


"*) = 500+ 1000+ uy” | 


eu 


=s[u 
ult) = ~[2000 tui? +u,"*? = 500] 
=s[05 


ae 404+u en +0] 
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First iteration:(put n = 0 in the above results) 


1 

uf ' = 7 (2000 + 625 + 1000 + 875) = 1125 
1 

us =a 125 + 500 + 1000 + 375) = 750 
1 

uf ' = 7 (2000 + 375 + 1125 + 500) = 1000 
1 

uf ' = 72000 +0 +750 + 0) = 438 


Second iteration: (put n = 1) 


1 
u?) = == (2000 +750 +1000 +1000) ~ 1188 


1 
= 71188 +500 + 1000 + 438) ~ 782 


1 
= = (2000 + 438 + 1188 + 500) ~ 1032 


I 
u?) = = (1032 +0+782 +0) = 454 


Similarly uj” + 1204,u” mca ) = 1040, u') = 458 
ul) = 1207, us = 791,u% = 1041,u\? = 458 


and uy” = 1208, ul? = 791.5,u0) = 1041.5,u2 = 458.25 


Thus there is no significant difference between the fourth and fifth 
iteration values. 


Hence u, = 1208, u, = 792, u, = 1042 and u, = 458. 
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EXAMPLE 11.4 


Solve the Laplace equation u,, + u,, = 0 given that 
a yy 


0 11.1 17 19.7 18.6 
uy u, u, 

0 - 21.9 
u Uu_ u. 

0 : ° 21 
u uy Uy 

0 17 

Q 
. 8.7 12.1 12.5 : 
FIGURE 11.8 
Solution: 


We first find the initial values in the following order: 
u,= © (0417421 + 12.1) =12.5 (Std. formula 
(0+12.5+0+17)=7.4 (Diag. formula 
(12.5 + 18.6 + 17 + 21) = 17.28 (Diag. formula 
(12.5+0+0+12.1)=6.15 (Diag. formula 
(12.5+9+21+412.1) = 13.65 (Diag. formula 


(174+ 12.5 + 7.4 + 17.3) = 13.55 (Std. formula 


(7.44+6.2+0+4 12.5) =6.52 (Std. formula 


(17.3 + 13.7 + 12.5 + 21) = 16.12 (Std. formula 


o 
| 
Ble Bl Bl BIR BIR BIR BIR B® 
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= = (12.5 +12.14+6.2+4 13.7) =11.12 (Std. formula) 
Now we carry out the iteration process using the standard formula: 
1 
ult) = 70 +1114uy? +u$"] 
: 1 
ae = rue D417 tu? + ul”) 
oe = A Tun +19.7+ uy” +219] 
3 4 . 6 +4 
1 
utd = rs tule) pu tu] 


1 
wns —[ul (n+1) ) yin) tu) + ue] 


1 
uf) = [ul (n+1) tus (n+1) +us” +21] 


ul) = [Ot u) $8.74 ue") 


q— 
i 
4 
1 
ug) = = qu ust tg. ust p19 1+ us] 

i 


uf) = lus tu) 412.8417] 


First iteration: (put n = 0, in the above results) 


ul)? == (0411 1+u) + us”) 


it 
= 7 (0 + 11.14 6.52 + 13.55) =7.79 
ul) = (7.19417 +125+17.28)= 13.64 
1 
ul ' = (13.64 +19.7 +16.12 +21.9) = 12.84 


1 
ul)? = (047.79 + 6. 15+12.5)=6.61 


1 
= 5 (6.61 + 13.64 + 11.12 + 16.12) = 11.88 


1 
ud ' = 7 (1188 + 17.84 + 13.65 +21) = 16.09 
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1 
“= rw +6.61+8.7+11.12)=661 

1 
us) = 7 (6.61 + 11.88 +12.1+13.65)=11.06 


1 
u = —(11.06 + 16.09 + 12.8 + 17) = 12.238 
a4 


Second iteration: (put n = 1) 


we = +(0 +11.14+6.61+13.64) =7.84 

i = +(7.84 +17+11.88 +17.84) = 16.64 

ue) = ~(13.64 + 19.7 + 16.09 + 21.9) =17.83 

uf?) = +(0 +7.84 + 6.61 + 11.88) = 6.58 

uf?) = +(6358 +13.64+11.06 + 16.09) = 11.84 
u?) = 7(1.84+ 17.83 + 14.24 + 21) = 16.23 

u?) = +(0 + 6.58 + 8.7 + 11.06) = 6.58 

i= +(6.58 +11.84+12.14+14.24)=11.19 


i 
i = (iiss + 16.23 + 12.8+17) =14.30 
Third iteration: (put n = 2) 


u?) = 7(0+ 11.1+6.58 + 13.64) = 7.83 

ue) = 7(7.83 +17 411.84 +17.83) = 13.637 
u?) = +(13.63 +19.7+16.23 + 21.9) = 17.86 
u?) = =(0 +7.83+6.58 + 11.84) = 6.56 


| 
i= 7 (6.56 + 13.63 +11.19 + 16.23) = 11.90 
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11 


if 
ue ' = (11.90 +17.86 + 14.30 +21) = 16.27 
1 
u® = 7 (0 46.56 +8.7 + 11.19) = 6.61 
1 
ue ' = (6.61 +11.90 + 12.1 + 14.30) = 11.23 


= == (IL 23 + 16.27 +12.8+17) =14.32 
Similarly 
u\? =7.82,u\ = 13.65, ul’ =17.88, ui? = 6.58, ul = 11.94, 
ul’) = 16.28, u% = 6.63, ug? = 11.25, ul = 14.33 
ul) =7.83,uP) = 13.66 a = 17.89,u?) = 6.50, ue’ = 11.95, 
ul = 16.29, ul?) = 6.64, uf? = 11.25,u9) = 14.34 
There is no significant difference between the fourth and fifth iteration 
values. 
Hence uw, = 7.83, u, = 13.66, u, = 17.89, wu, = 6.6, u, = 11.95, u, = 16.29, 
u, = 6.64,u, = 11.25, u, = 14.34. 


-6 Solution of Poisson’s Equation 
au ou 
ar ae f(x,y) (1) 
Ox oy 


Its method of solution is similar to that of the Laplace equation. Here the 
standard five-point formula for (1) takes the form 


u., +u., tu... tu, ~ 4u, ,=hflih, jh) (2) 


lj i+Lj i, j+1 ij-l 
By applying (2) at each interior mesh point, we arrive at linear equations 
in the nodal values u,, . These equations can be solved by the Gauss-Seidal 
method. 


NOTE Obs. The error in replacing u,, by the finite difference 


approximation is of the order O(h?). Since k=h, the error in 
replacing u,, by the difference approximation is also of the 
order O(h 2y) ‘Hence the error in solving Laplace and Poisson’s 
equations by finite difference method is of the order O(h?). 


NUMERICAL SOLUTION OF PARTIAL DIFFERENTIAL EQUATIONS * 509 


EXAMPLE 11.5 
Solve the Poisson equation uw. + Uy = — Slxy,0<x<1,0<y< 1 given 
that u(0, y) = 0, u(x, 0) = 0, u(1, y) = 100, u(x, 1) = 100 andh = 1/3. 
Solution: 
Here h = 1/3. 


The standard five-point formula for the given equation is 


Ups hg Pty ag = h*flih, jh) 
=h? [- 81 (ih . jh)] =h* (- 81) ij =-ij (i 
For u, (i = 1,7 = 2), (i) gives O+u, +u,+ 100 —4u,=- 2 
Le., —4u, +u,+u,=- 102 (ii 
For u, (i = 2, j = 2), (i) gives u, + 100 +u, + 100 - 4u,=—4 


ieé., u,—4u,+u,=— 204 (iti 


For u, (i = 1,j = 1), (i) givesO+u,+0+u, -4u,=—- 


ié., u,—4u,+u,=—-1 (iv 


1 


For u, i = 2,7 = 1) givesu, + 100 +u, —4u,=—2 


Les u, +u,—4u,=— 102 (v 
YA - 
‘ 100u = 100 a 
uy Uy 
0 100 
) Ss 
TT rl 
~ Il 
~ u, u, = 
0 100 
0 0 0 0x 
u=0 s 
FIGURE 11.9 
Subtracting (v) from (ii), — 4u, + 4u,=0,i.e,u,=u, 
Then (iii) becomes 2u, — 4u, = — 204 (vi) 


and (iv) becomes 2u, — 4u,=- 1 (vii) 
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Now (4) x (ii) + (vi) gives — 14u, + 4u, =- 612 (viii) 
(vii) + (viii) gives - 12u, =- 613 
Thus u, = 613/12 = 51.0833 = u,. 


1 
From (vi), Uy = gl + 102) = 76.5477 


1 1 
From (vii), U3 =3{u4 +5) =25.7016 


EXAMPLE 11.6 


Solve the equation V*u —10(x? + y? + 10) over the square with sides x = 
0=y, x = 3=y with u = 0 on the boundary and mesh length = 1. 


Solution: 
Here h = 1. 
.. The standard five-point formula for the given equation is 
ggg ae eM a ie — 10(? +7? + 10) (i) 
For u, (i= 1,j = 2), (i) givesO +u,+0+u,-4u,=- 10(1 + 4+ 10) 
i.e., u, -| (u, +u, + 150) (ii) 
Y, 
0 0 0 
u, u, 
0 - 0 
u, Uy, 
0 ; 0 
> 
0 0 0 0x 


FIGURE 11.10 


For u, (i= 2,j =2), (i) gives =u, =—(u, +u, + 180) (iii) 


For u,(i = 1,7 = 1), we have u,=—(u, tu, + 120) (iv) 


Ble Ble 
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Foru, @=2,j=1),wehave wu a, +u,+ 150) (v) 
4 if 4 4 2 3 


Equations (ii) and (v) show that wu, =u,. Thus the above equations re- 


duce to 


u,= a (u, +u, + 150), u, = = (u, + 90), u, = : (u, + 60) 


aN 
a 


Now let us solve these equations by the Gauss-Seidal iteration method. 


First iteration: Starting from the approximations u, = 0, u, = 0, we obtain 
a,” = 37.5 


i 
Then ul) = g 875 +90) = 64 
1 
ul) = 3875 +60) = 49 
or ed ok 
Second iteration: ul?) = 3 (64 +49 +150) = 66, ul” = 3 (66 +90) =78 


i 
u?) = 5 (66 +60) = 63 


4 
u?) =(73 + 60) = 67 


Prone | i 
Third iteration: — u\?) =—(78+ 63+ 150) = 73, u$? = 363 +90) = 82, 


Fourth iteration: —u\’) =(82+67+150) ~ 75, u$ =(75 +90) = 82.5, 
uS) = (75+ 60) =67.5 


Fifth iteration: ul) = (82.5 +67.5 +150) = 75,us” =(75 + 90) = 82.5, 
ul? =(75 +90) = 67.5 


Since these values are the same as those of fourth iteration, we have 
u, = 75, u, = 82.5,u, = 67.5 and w, = 75. 


Exercises 11.2 


1. Solve the equation wu, + vu, = 0 for the square mesh with the boundary val- 
ues as shown in Figure 11.11. 
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12 0 0 1 
0 2 
1 4 
0 2 
2 5 
0 2 
45 0 0 1 
FIGURE 11.11 FIGURE 11.12 


2. Solve u,+u,, =0 over the square mesh of side four units satisfying the 
following boundary conditions: u (0, y) =0 for0<y <4,u (4,y)=12+y 
for 0 <y <4; u(x, 0) = 8x for 0 <x < 4,u (x, 4) =x’ forO<x< 4. 


3. Solve the elliptic equation u, + u, Vs = 0 for the square mesh with bound- 
ary values as shown in Figure 11.12. Iterate until the maximum differ- 
ence between successive values at any point is less than 0.005. 


1 2 p) 2 
60 60 60 60 
0 p) 
40 50 
20 40 0 2 
0 10 20 30 0 0 0 1 
FIGURE 11.13 FIGURE 11.14 


4. Using central-difference approximation solve V*u = 0 at the nodal points 
of the square grid of Figure 11.13 using the boundary values indicated. 


5. Solve u, + u,, = 0 for the square mesh with boundary values as shown 


in Figure 11.14. Iterate till the mesh values are correct to two decimal 
places. 
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0 1 4 9 16 
1 l 0 14 
u_ us Uy 
0 12 
0 U, u 0 U, U, U, 
0 uy uy 0 0 uy u u 10 
0 0 0 0.5 2 45 ° 
FIGURE 11.15 FIGURE 11.16 


6. Solve the Laplace’s equation wu + v= = 0 in the domain of Figure 11.15 
by (a) Jacobi’s method, (b) ‘coe Berd method. 


7. Solve the Laplace’s equation V’u = 0 in the domain of the Figure 11.16. 


8. Solve the Poisson’s equation V*u = 8x*y? for the square mesh of Figure 
11.17 with u(x, y) = 0 on the boundary and mesh length = 1. 


Y, 


0 0 0 0 


u u, 0 


mV 


0 0 0 0 
FIGURE 11.17 FIGURE 11.18 


11.7 Solution of Elliptic Equations by Relaxation Method 


If the equations for all the mesh points are written using (2) of Section 
11.6, we get a system of equations which can be solved by any method. For 
this purpose, the method of relaxation is particularly well-suited. Here we 
shall describe this method in relation to elliptic equations. 
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Consider the Laplace equation 


vu du 
+7 =0 (1) 

ax” ay” 
We take a square region and divide it into a square net of mesh size h. Let 
the value of u at A be u, and its values at the four adjacent points be w,, u,, 
u,, u, (Figure 11.19). Then 


2 
Ou uy + Us — 2ty 


2 
Ou Uy tu, —2u 
‘ 4 0 
5 and —~ ~—2 
Ox 


h? oy” h> 
If (1) is satisfied at A, then 

Uy _U3 —2Uy | Uy FUy—2Uy _ 

OR 7 

or u,tu,+u,+u,—4u,~90 


0 


If r, be the residual (discrepancy) at the mesh point A, 
then rj=u,t+u,+u,+u,—4u, (2) 


Similarly the residual at the point B, is given by 


r,=u,tu,t+u,+u,— 4u, and so on (3) 
@ @ 
uy u 
@ @ @ 
u A Uy B uy u 
oO oO 
u, u 


FIGURE 11.19 


The main aim of the relaxation process is to reduce all the residuals to 
zero by making them as small as possible step by step. We, therefore, try 
to adjust the value of wu at an internal mesh point so as to make the residual 
thereat zero. But when the value of u is changing at a mesh point, the values 
of the residuals at the neighboring interior points will also be changed. Ifu, 
is given an increment 1, then 


(i) (2) shows that r, is changed by — 4. 
(ii) (3) shows that r, is changed by 1. 
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i.e., if the value of the function is increased by 1 at a mesh point (shown by 
a double ring), then the residual at that point is decreased by 4 while the re- 
siduals at the adjacent interior points (shown by a single ring), get increased 
each by 1. This relaxation pattern is shown in Figure 11.20. 


FIGURE 11.20 


Working procedure to solve an equation by the relaxation method: 


L 


IL. 


III. 


IV. 


VI. 


Write down by trial, the initial values of u at the interior mesh 
points by diagonal averaging or cross-averaging. 


Calculate the residuals at each of these points by (2) above. If we 
apply this formula at a point near the boundary, one or more end 
points get chopped off since there are no residuals at the boundary. 


Write the residuals at a mesh-point on the right of this point and 
the value of u on its left. 


Obtain the solution by reducing the residuals to zero, one by one, 
by giving suitable increments to u and using Figure 11.20. At each 
step, we reduce the numerically largest residual to zero and record 
the increment of u on the left (below the earlier value thereat) and 
the modified residual on the right (below the earlier residual). 


. When a round of relaxation is completed, the value of u and its in- 


crements are added at each point. Using these values, calculate all 
the residuals afresh. If some of there calculated residuals are large, 
liquidate these again. 


Stop the relaxation process, when the current values of the residu- 
als are quite small. The solution will be the current value of u at 
each of the nodes. 
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Obs. Relaxation method combines simplicity with the speed of 


NOTE 
——— convergence. Its only drawback is its unsuitability for computer 
calculations. 
au dou 
EXAMPLE 11.7 du, du_y 


2 
Solve by relaxation method, the Laplace equation a inside 
the square bounded by the lines x = 0, x = 4, y = 0, y = 4, given that wu = x°y? 
on the boundary. 


ay” 


Solution: 


Taking h = 1, we find u on the boundary from u = x°y’. The initial values 
of u at the nine mesh points are estimated to be 24, 56, 104; 16, 32, 56; 8, 
16, 24 as shown on the left of the points in Figure 11.21. 


“. Residual at A, i.e. r,=0+56 + 16+ 16-4 x 24=-8 


Similarly r, = 0, r,=— 16, r, =0,1r, = 16, r,,.=0,r,=0, r,,=0,r,=-8. 
(i) The numerically largest residual is 16 at E. To liquidate it, we increase 


u by 4 so that the residual becomes zero and the residuals at neighbor- 
ing nodes get increased by 4. 


Y 4 
4 16 64 144 256 
0 Z - e 144 
24 | -8 56 | 0 104 | -16 
2 10 4 4 10 
= 
-2 
0 D E F 6A 
16 | 0 32 | 16 56] 0 
4 4/0 4 
2 —4 
~2 
0 G H u 16 
810 16] 0 24 |-8 
4 -2| 0 
-2 
> 


0 0 0 0 0 X 
FIGURE 11.21 
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(ii) Next, the numerically largest residual is — 16 at C. To reduce it to 
zero, we increase u by — 4 so that the residuals at the adjacent nodes 
are increased by — 4. 


(iit) Now, the numerically largest residual is — 8 at A. To liquidate it, we in- 
crease u by— 2 so that the residuals at the adjacent nodes are increased 
by — 2. 

(iv) Finally, the largest residual is — 8 at I. To liquidate it, we increase u 
by — 2 so that the residuals at the adjacent points are increased by — 2. 


(v) The numerically largest current residual being 2, we stop the relax- 
ation process. Hence the final values of wu are: 


u, = 22, u, = 96, u, = 100, 
u,, = 16, u, = 36, u, = 96, 
u,=8, u,, = 16, u, = 22. 


EXAMPLE 11.8 
Solve by relaxation method Example 11.3. 
Solution: 


(i) The initial values of u at A, B, C, and D are estimated to be 1000, 
625, 875, and 375 [Figure 11.22 (i)]. 


1000 1000 1000 1000 


2000 2 z 500 


1000 | 500 625 | 375 
125 | 0 94 | 125 


94 = 
cl bp 
2000 =| acesoae 0 
875 | 375 3750 
125 94 
94) _] 94 


1000 
500 0 0 


FIGURE 11.22 (1) 
; r, = 900, r, = 375, r, = 375, r, = 0 


To liquidate r,, increase u by 125 
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To liquidate r,, increase u by 94 
To liquidate r,, increase u by 94 
(ii) Modified values of u are 1125, 719, 969, 375 [Figure (ii)] 


1000 1000 1000 1000 
A B 
2000 /J-_ + +} "| __1 599 
1125 J1ss8 719] 194 
47 |0 AT 
31 | 47 
gi Bll 
2000 e 2 0 
969 |124 375 |188 
47 47 0 
47 31 
1000 D Al 


500 0 0 
FIGURE 11.22 (II) 
r, = 188, r, = 124, r, = 124, r, = 188. 


To liquidate r,, r,,, r,, 7, increase u by 47, 47, 31, 31 in turn, 
(iii) Revised values of u are 1172, 750, 1000, 422 | Figure (iii)] 


1000 1000 1000 1000 
2000 A s 500 


21 15 

2 15 
2000 Cc D 0 

1000 }84 429 | 62 

21 |0 15 |: 

15 21 

1000 15 20 
5000 0 


FIGURE 11.22 (II) 


r, = 62, r, = 84, r= 84, r, = 62 
To liquidate r,, r,, r,, 7) increase u by 21, 21, 15, 15, respectively. 
(iv) Improved values of u are 1187, 771, 1021, 437 [Figure (iv)] 
r,=44,r,=40,r, =40, r, = 44. 
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To liquidate r,, r,,, r,, 7, increase u by 11, 11, 10, 10, respectively 


1000 1000 1000 1000 
2000 = 2 500 
1187 |44 77140 
11] 9 ll 

10 WO | 4 
10 
C p\° 
2000 7 0 
1021 |40 437) 44 
ll 11}0 
10 |11 10 
0 10 


1000 
500 0 0 


FIGURE 11.22 (IV) 
(v) Modified values of u are 1198, 781, 1031, 448 [Figure (v)] 


r,= 20, r= 22, ro= 22, ry= 20. 


1000 1000 1000 1000 
2000 a B 500 
1198 }20 781] 22 
5 [5 5/2 

5 5 

0 5 
C D é 

2000 

1031] 22 448] 20 

5 |2 5/5 

5 5 

6 2 

1000 2 = 
500 0 0 


FIGURE 11.22 (V) 
To liquidate r,, r,, r,, 7, increase u by 5, 5, 5, 5, respectively. 
(vi) Revised values of u are 1203, 786, 1036, 453 [Figure (vi) ] 
r,=10,r,=12,r,= 12,r,=10 


To liquidate r,, r,, r,, 7, increase u by 3, 3, 2, 2, respectively. 
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1000 1000 1000 1000 1000 1000 1000 1000 
A B 
2000 Z : 500 2000 500 
1203 }10 786 |12 1205 |8 789 | 4 
2/3 3] 0 210 1|2 
3 2 1 2 
2 2 1 j 0 
2000 is 2 0 2000 . 0 
1036 |12 453] 10 1039 | 4 455 |8 
3 0 2 3 2 2|0 
2 3 1}2Q 
1000 2 2 1000 2 i 
500 0 0 500 0 
FIGURE 11.22 (VI) FIGURE 11.22 (VII) 


(vii) Improved values of u are 1205, 789, 1039, 455 [Figure (vii)] 


r,=8,7r,=4,7,=4 7, =8. 


To liquidate r,, r,, r,, : increase u by 2, 2, 1, 1. 


(viii) Finally the current residuals being 1, 0, 0, 1, we stop the relaxation 
process. 


Hence the values of u at A, B, C, D are 1207, 790, 1040, 457. 


Exercises 11.3 


1. Given that u(x, y) satisfies the equation V7u = 0 and the boundary condi- 
tions are u(0, y)= 0, u(4, y) = 8 + 2y, u(x, 0) = ; x?, u(x, 4) =x?, find the 
values u(i, j), i= 1, 2, 3; = 1, 2, 3by the relaxation method. 


2. Apply the relaxation method to solve the equation V*u = — 400, when 
the region of u is the square bounded by x = 0, y = 0, x =4, and y = 4 and 
u is zero on the boundary of the square. 


3. Solve by relaxation method, the equation V?u = 0 in the square region 
with square meshes(Figure 11.23) starting with the initial values u, = 
u,=u,=u,=1. 


1 4/3 


5/3 


2/3 


5/3 


1/3 


4/3 


0 1/3 
FIGURE 11.23 


2/3 


11.8 Parabolic Equations 


The one-dimensional heat conduction equation 2“ 
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2 
Ou 


o Vis a well- 


ax” 


known Example of parabolic partial differential equations. The solution of 
this equation is a temperature function u(x, t) which is defined for values of 
x from 0 to | and for values of time t from 0 to 0.The solution is not defined 
in a closed domain but advances in an open-ended region from initial val- 
ues, satisfying the prescribed boundary conditions (Figure 11.24). 


Boundary 
conditions 
prescribed 
along this 
line 


took 


aT 


Sol. Advances 


Open-ended 
domain 


R 


A 


oS 


Boundary 
conditions 
prescribed 
along this 
line 


Initial conditions 


prescribed along this line 


FIGURE 11.24 


In general, the study of pressure waves in a fluid, propagation of heat 
and unsteady state problems lead to parabolic type of equations. 
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11.9 Solution of One Dimensional Heat Equation 


=cC (i) 
where c? = k/sp is the diffusivity of the substance (cm’/sec.) 


Schmidt method. Consider a rectangular mesh in the x-t plane with spac- 
ing h along x direction and k along time t direction. Denoting a mesh point 
(x, t) = (ih, jk) as simply i, j, we have 


Ou _ Mage 7 Mas [by (5) Section 11.3. 
ot k 
2 UW. —2u.. tu. ; 

and 3 = — ily nD) With [by (4) Section 11.3. 

ax? h? 

2 

Substituting these in (1), we obtain tg “ [ues = 2u, , + Ui jl 
or ig Clg 2 (1 — 2a) u, tu, , (2) 


where @ = ke*/h? is the mesh ratio parameter. 


This formula enables us to determine the value of w at the (i, j + 1)th 
mesh point in terms of the known function values at the points x, ,, x, and 
x,,, at the instant t. It is a relation between the function values at the two 
time levels j + 1 andj and is therefore, called a two-level formula. In sche- 
matic form (2) is shown in Figure 11.25. 


TA 


i, j+l j+1)th level 
(i, j+ 4 (j+1)th leve 


h jth level 
& & > 
(ay) ipl GLP x 


FIGURE 11.25 


Hence (2) is called the Schmidt explicit formula which is valid only for 
O0<aK<l2. 


NUMERICAL SOLUTION OF ParRTIAL DIFFERENTIAL EQUATIONS ¢ 523 


NOTE Obs. In particular when a = 1/2, (2) reduces to 
— toa 1/2, (u, 4, + Ui) (3) 


which shows that the value of u at x, at time t,,,is the mean of 
the u-values at x, , and x,,, at time t. This relation, known as 
Bendre- Schmidt recurrence relation, gives the values of u at the 
internal mesh points with the help of boundary conditions. 


Crank-Nicolson method. We have seen that the Schmidt scheme is com- 
putationally simple and for convergent results @ < 12 i.e., k < h?/2c°. To 
obtain more accurate results, h should be small i.e. k is necessarily very 
small. This makes the computations exceptionally lengthy as more time lev- 
els would be required to cover the region. A method that does not restrict 
a and also reduces the volume of calculations was proposed by Crank and 
Nicolson in 1947. 


According to this method, 0°u/dx? is replaced by the average of its cen- 
tral-difference approximations on the jth and (j + 1)th time rows. Thus (1) 
is reduced to 


Ui jt Mig og LY Minny —2u, Fi; Una jar — 2U; js + Misa, js 
ho ih i? 

or — AU yt (2+ 201), 43 —au au,, ,+ (2— 20), , + atu. (4) 

where @ = ke*/h?. 


Clearly the left side of (4) contains three unknown values of wu at the (j + 
1)th level while all the three values on the right are known values at the jth 
level. Thus (4) is a two level implicit relation and is known as Crank-Nicolson 
formula. It is convergent for all finite values of @. Its computational model 
is given in Figure 11.26. 


i+], jt1 


T 


i-l,j+1 i, j+1 i+], j+1 j + 1)th level 
(-L j+1) as (i, j+)) ae jt) ns )th leve 


k 


h jth level 
(i-1,/) (i,j) (i+1 j) 


aY 


FIGURE 11.26 
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If there are n internal mesh points on each row, then the relation (4) 
gives n simultaneous equations for the n unknown values in terms of the 
known boundary values. These equations can be solved to obtain the values 
at these mesh points. Similarly, the values at the internal mesh points on 
all rows can be found. A method such as this in which the calculation of 
an unknown mesh value necessitates the solution of a set of simultaneous 
equations, is known as an implicit scheme. 


Iterative methods of solution for an implicit scheme. 


From (4), we have 


1 
(1 + a) Uy jaa en OE a cate nee) + u, ;+ 2 alu, ~ Qj te Us ;) (5) 
Here only u, ,,,, Uj, 4, and u,,, ,,, are unknown while all others are 


known since these were already computed in the jth step. 


ope a 
Writing b, =u; ; +5 (u, — 2u, + tans) 


and dropping j’s (5) becomes u; = (uj. + ta) + 


ls oP 
2(1+a) l+a 


This gives the iteration formula 


(ntl) @ (n) (n) b; 

u; = —— 0,5 tu p+ 6 

i 2(1 ae ay 1 oh ( ) 
which expresses the (n + 1)th iterates in terms of the nth iterates only. 

This is known as the Jacobi’s iteration formula. 


As the latest value of u, , i.e, u\{” is already available, the convergence 


of the iteration formula (6) can be improved by replacing u\") by u\"{”. 


Accordingly (6) may be written as 


b, 
yortD) = n+1) tui be i (7) 


( 
; mise) l+a 
which is known as the Gauss-Seidal iteration formula. 
NOTE Obs. Gauss-Seidal iteration scheme is valid for all finite values 
of a and converges twice as fast as Jacobi’s scheme. 
Du Fort and Frankel method. If we replace the derivatives in (1) by the 
central difference approximations 


ou _ Wi pti Yi jl [From (7) Section 11.3] 
ot 2k 
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2 2 
ou Y-1; QU, j-14Uis1,j 


and z= : [From (4) Section 11.3] 
ox h 
2 
we obtain u —u,.. = 2kew lu. -2u. tu... | 
ijt i,j-l h2 i-l,j ij i+1,j 
i.é., ty 9 Uy gg 2c lus, - 2u, , + Ui jl (8) 


where @ = kc*/h?. This difference equation is called the Richardson 
scheme which is a three-level method. 


If we replace u, ; by the mean of the values tig and wu, 


ijt 
i€., U, = (Uy i + U, jin (8), then we get 
Og SU pgau t 2a[u,; - Cre + Us, sas) + eel 
On simplification, it can be written as 
1-2a 2a 
Uy jt = 142a Uj + 142a {ui a Uiarj} (9) 


This difference scheme is called Du Fort-Frankel method which is a 
three level explicit method. Its computational model is given in Figure 11.27 
a 
(i, j+1) (i+1)th level 


jth level 
@ & > 


(i-1, j) (+1, j) x 


(j-1)th level 


a 
7 


(i, j-1) 
FIGURE 11.27 


EXAMPLE 11.9 


2 
Solve a= ao in 0 <x <5,t2 0 given that u(x, 0) = 20, u(0, t) = 0, 

u x 
u(5, t) = 100. Compute u for the time-step with h = 1 by the Crank-Nicholson 


method. 
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Solution: 
Here c?=1landh=1. 
Taking @ (i.e., c*k/h) = 1, we get k = 1. 


Also we have 


=] 0 1 2 3 4 5 
i 


0) 0 20 20 20 20 100 
0) u u, Us u, 100 


Then Crank-Nicholson formula becomes 


4u +u +u., +u 


ig ~ “Yaga Yea “ay © Gog 
4u,=0+20+0+u,ie., 4u, —u, = 20 1 
4u, = 20+ 20 +u, +u,i.e., u, —4u, +u, =— 40 2 
4u,= 20+ 20+u, +u,i.e., u,—4u,+u,=— 40 (3 
du, = 20+ 100 +, + 100 i.e, u,— 4u, = — 220 4 

Now (1) — 4(2) gives 15u, — 4u, = 180 (5 

4(3) + (4) gives 4u, — 15u, =— 380 6 

Then 15(5) — 4(6) gives 209 wu, = 4220 i.e., u, = 20.2 

From (5), we get 4u,=15 x 20.2 — 180 i.e., u, = 30.75 

From (1), 4u, = 20 + 20.27e., ul = 10.05 

From (4), 4u , = 220 + 30.75 i.e., u4 = 62.69 


Thus the required values are 10.05, 20.2, 30.75 and 62.68. 


EXAMPLE 11.10 


Solve the boundary value problem u, = u,, under the conditions u(0, t)= 
u(1, t) = 0 and u(x, 0) = sin pr, OS x < i using the Schmidt method (Take 
h =0.2 anda = 1/2). 


Solution: 


Since h=02anda=\% 
a= ca gives k = 0.02 
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Since a= 1/2, we use the Bendre-Schmidt relation 
1 
Ui i+ = als + Ui+1,;) (i) 
We have u(0, 0) = 0, u(0.2, 0) = sin 27/5 = 0.5875 
u(0.4, 0) = sin 27/5 = 0.9511, u(0.6, 0) = sin 32/5 = 0.9511 
u(0.8, 0) = sin 47t/5 = 0.5875, u(1, 0) = sin zz =0 


The values of vu at the mesh points can be obtained by using the recur- 
rence relation (i) as shown in the table below: 


x2 0 0.2 0.4 0.6 0.8 1.0 

t 

I ‘ 0 1 2 3 4 5 

(0) i 

0 0 0.5878 | 0.9511 | 0.9511 | 0.5878 0 

0.02 1 0 0.4756 | 0.7695 | 0.7695 | 0.4756 0 
0.04 2 0 0.3848 | 0.6225 | 0.6225 | 0.3848 0 
0.06 3 0 0.3113 | 0.5036 | 0.5036 | 0.3113 0 
0.08 4 0 0.2518 | 0.4074 | 0.4074 | 0.2518 0 
0.1 5 0 0.2037 | 0.3296 | 0.3296 | 0.2037 0 


EXAMPLE 11.11 
2 
Find the values of u(x, t) satisfying the parabolic equation ~ = fi 
t Ox 
and the boundary conditions u(0, t) = 0 = u(8, t) and u(x, 0) = 4x — (1/2) x? at 
the points x = ii = 0, 1, 2, ---, 7andt=1/8 j:j = 0, 1,2, ---,5 
Solution: 
Here c?=4,h=1landk=I1/8. Thena =c?k/h? = 1/2. 
“. We have Bendre-Schmidt’s recurrence relation 
Ue = 1/2 u, +u=) (i) 
Now since u(0, t) =0=u(8, t) 
Uy = 0 and u = 0 for all values of j, i.e., the entries in the first and 
last column are zero. 
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Since u(x, 0) = 4x — (1/2) x? 
u, = 4i - (1/2) 2 
= 0, 3.5, 6, 7.5, 8, 7.5, 6, 3.5 fori =0, 1, 2, 3, 4, 5, 6, 7 
at t=0 
These are the entries of the first row. 
Putting j = 0 in (i), we have wu, , = (1/2) Cia $b ) 


Taking i = 1, 2, ---, 7 successively, we get 


1 1 
U4, = 5 (to, o tg 9) = ; —(0+6)=3 
1 1 
Ug) = 9 to + Ua) = (3547.5) = 5.5 
1 1 
U3) = 5 la, 9 t+ tao) = 5 —(6+8)=7 
u,,= 1.0; u.,= 7, U, = 5.0, u, = 


These are the entries in the second row. 


Putting j = 1 in (i), the entries of the third row are given by 
1 
U9 = g (Miata + tia) 


Similarly putting j = 2, 3, 4 successively in (i), the entries of the fourth, 
fifth, and sixth rows are obtained. 


Hence the values of u, , are as given in the following table: 


0 1 2 3 4 5 6 W 8 


3.5 6 7.5 8 7.5 6 3.5 
3 5.5 7 7.5 7 5.5 2 
2.75 5 6.5 7 6.5 5 2.75 
2.5 
2.3125 | 4.25 | 5.5625 6 5.5625 | 4.25 | 2.3125 


ol PBlwlrmle|o|s. 
o/cololo|colo 
bo 
Ol 
a 
a5 | OQ lols 
i) 

Ol 
ro) 
o>) 

Ol 
ro) 
od 
>) 
bo 
Ol 
SCIolo|[cololo 


2.125 | 3.9375 | 5.125 | 5.5625 | 5.125 | 3.9375 | 2.125 
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EXAMPLE 11.12 
2 
Solve the equation = = subject to the conditions u(x, 0) = sin zx, 
y ox 
O<x<1;u(0,t) =u(1, t) =0, using (a) Schmidt method, (b) Crank-Nicolson 


method, (c) Du Fort-Frankel method. Carryout computations for two 
levels, taking h = 1/3, k = 1/36. 


Solution: 
Here c? = 1,h=1/3, k = 1/36 so that @ =keVh? = 1/4. 


Also w, . = sin 2/3 = 3/2, u, = Sin 20/3 = \3/2 and all boundary values 
are zero as shown in Figure 11.28. 


3/2 V3/2 9 
FIGURE 11.28 
(a) Schmidt’s formula |(2) of Section 11.9] 


u =au,,,+(1-2a)u, +a, 


ijt i+lj 


1 
becomes Ui jn = qin +2, 5 + U4, ;] 


For i= 1, 2;7 =0: 


[u, gt Qu, ,+u, ] = — (042 x V3/2 + 3/2) = 0.65 


[u, 9+ Qu, tu, 9] = — (VB/2 +2 x VB/2 +0) = 0.65 


(uy | + Qu, tu, ,) = 0.49 


(uw, , + Qu, +u, ,) = 0.49 


hy 
° 
= 
~. 
ll 
- 
i Ale SS wile Ble 
a. 
Il 
—_ 
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(b) Crank-Nicolson formula |(4) of Section 11.9] becomes 


1 5 
3 Usa ja - Ui, i ~ ri u 
Fori=1, 2:7 =0: 


= g 10u, ;-U,,= by gt Bu, pty 


ie., ldu, .—u, = 7V3/2 


1,1 2,1 
—u,,+10u, ,—u, , =U, ,+6u, +t, , 
ie., —u, ,+10u, , = 73/2 
Solving these equations, we find 
u, =U, , = 0.67 


1 
i+], j+l 4 i-Lj ac 4 “it j 


Fori=1, 2;j=1: 


= gst 10u, .— Uy 4 =u,,+ Gu, | th, j 


i.é., 10u, , Sty = 4.69 
tig t Otis 5= u,,=u,,+ 6u, ; at thas 
i.e, t+ 10 96 = 4.69 


Solving these equations, we get u 1g = Ug, = 0.52. 
(c) Du Fort-Frankel formula |(8) of Section 11.9] becomes Ue ai = I (u, 
gpg Use) 3 


To start the calculations, we need u, , and ths 4 
We may take uw, , =u, , = 0.65 from Schmidt method. 
Fori=1, 2;j=1: 


= — (Uy ott, +4, ,)= — (V8/2+0+0.65) =05 


£ 
3 
1 


(V3/2 + 0.65 + 0) = 0.5. 


Col rR wire 


; (u, a d= 


11.10 Solution of Two Dimensional Heat Equation 


ou ae: ( nN | (1) 


at ax” ay” 


The methods employed for the solution of one dimensional heat equa- 
tion can be readily extended to the solution of (1). 
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Consider a square region 0 <x < y <a and assume that u is known at all 
points within and on the boundary of this square. 

If h is the step-size then a mesh point (x, y,t) = (ih, jh, nl) may be de- 
noted as simply (i, j, n). 

Replacing the derivatives in (1) by their finite difference approxima- 
tions, we get 


Uj; ; =U; ; 2 
pnt 1 ijn _C = 
i] 2 CA nn 2u, | n a Yay, Py + Cn n 2u, | n + Uy iat, ws 


Le., ae) eas au, Fos 


PU —4u) (2) 


a ij, n 


where @ = Ic*/h?. This equation needs the five points available on the nth 
plane (Figure 11.29). 


—_l(i, j,n + 1) 


FIGURE 11.29 


The computation process consists of point-by-point evaluation in the 
(n + 1)th plane using the points on the nth plane. It is followed by plane- 
by-plane evaluation. This method is known as ADE (Alternating Direction 
Explicit) method. 


EXAMPLE 11.13 


Solve the equation °“ subject to the initial conditions 
du dx oy” 


u(x,y, 0) = sin 2 x sin 2 y, 0 < x, y < 1, and the conditions u(x, y, t) = 0, 


Ou au dou 
=—~+— 
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t > 0 on the boundaries, using ADE method with h = 1/3 and a = 1/8. (Cal- 
culate the results for one time level). 


Solution: 
The equation (2) above becomes 
= 1 / _ 
us nt] us n ae (uy, n + Wir, n + Us pin 7 Uy i, n 4u, P| 
8 
Le u at u.. + = (u +u +u +u ) (1) 
eee 4j, nal 2 i,j, 8 i-Lj.n itljen ijtln i,j-Ln 


The mesh points and the computational model are given in Figure 
11.30. 
| 


II Level 


(2,0, 1) (3,0,1) 


(43,1) @3,1) (3,8, 1) 
(0, 0, 0) (1,0,0) (2,0,0) (3,0, 0) 


ny 


(0, 1, 0) 


(0,2, 0) 


(0, 3,0) 
(1,3,0) (2,3,0) (3,3, 0) 


y 
FIGURE 11.30 
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At the zero level (n = 0), the initial and boundary conditions are 
_ , Qui | Qi 
Ui 5.0 = oe 9g ee 


3 
and =u, 0, 0 =u, j, O=u,,j, 0=u, 3, 0=0; 1,7 =0, 1, 2, 3. 


Now we calculate the mesh values at the first level: 


For n = 0, (1) gives 


a 1 1 ‘ 
thy = - that . Care AP pg th cig sain) (2) 
(i) Put i =/ = 1 in (2): 
1 1 
ai ie Y 8 (Uy oF Ua 10 M1,2,0 7 1,00) 


4 


lf. ay 1 An. Wn . Wn. A 
=—!sin—] +—|0+sin sin +sin sin +0 
2 3 8 3 3 3 


344 -Sx Bx Gu Bs| 3 
8° 8 


2 2 2 2 16 
(ii) Put i = 2, j = 1 in (2) 
ey = Mao t oy ota ot oor US ip) 
p) ao 2,0, 


(iii) Put i = 1, 7 = 2 in (2) 
1 
Uso ; uy aot 8 (u, 2 priya Chay 
1. Qn. 4nd _ An\ — on\ 
=—sin sin + 0+] sin—] +0+] sin— 
2, 3 3 8 3 3 
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(iv) Put i = 2, j = 2 in (2): 


1(. 4x) 1(. Qn. 40 An. On 
=—] sin +—] sin sin +0+0+sin —sin— 
3 3 3 3 


Similarly the mesh values at the second and higher levels can be calculated. 


Exercises 11.4 


1. Find the solution of the parabolic equation wu, = 2u, when u(0, t) = u(4, t) 
= 0 and u(x, 0) =x(4—x), taking h = 1. Find the values up tot =5. 
2. Solve the equation a ~ with the conditions u(0, t) = 0, u(x, 0) = 
a t 


x(1—x), and u(1, t) =0. Assume h = 0.1. Tabulate u for t=k, 2k and 3k 
choosing an appropriate value of k. 


3. Given 7 F _ Ff =0,f(0,t)=f(5, t) =0, flx, 0) =x2(25 —2°); find the 

ax” of 

values of f for x =ih (i=0, 1, ...,5) andt =jk (7 =0, 1, ..., 6) withh =1 
and k = 1/2, using the explicit method. 


4. Given 0u/0t = Cu/dt?, u(0, t) = 0, u(4, t) =0 and u(x, 0) =x/3(16 —x?). 
Obtain u,. ,forl0 = 1, 2,3, 4 andj = 1, 2 using Crank-Nicholson’s 
method. 


(0, #) = 


2 
5. Solve the heat equation lg = d 7 
Ot = ax” 


u(1,t)=0 and 
(x0) 2x forO<x <1/2 
ie 2(1-x) for 1/2< x<1 
Take h = 1/4 and k according to the Bandre-Schmidt equation. 


6. Solve the two dimensional heat equation %% — du sts du satisfying the 
ot 9 une 
ac 


ay” 
initial condition: u(x, y, 0) = sin zx sin zy, 0 <x, y < 1 and the boundary 
conditions: wu = 0 at x = 0 and x = 1fort > 0. Obtain the solution up to two 
time levels with h = 1/3 anda = 18. 
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11.11. Hyperbolic Equations 


2 
u as is the simplest Example of hyperbolic 
" 


2 

The wave equation + =< 
partial differential equations. Its solution is the displacement function u(x, 
t) defined for values of x from 0 to 1 and for t from 0 to ©, satisfying the 
initial and boundary conditions. The solution, as for parabolic equations, 
advances in an open-ended region (Figure 11.24). In the case of hyperbolic 
equations however, we have two initial conditions and two boundary condi- 
tions. 


Such equations arise from convective type of problems in vibrations, 
wave mechanics, and gas dynamics. 


11.12 Solution of Wave Equation 


2 3 
ou ».d0u 


1 
a axe Wy) 
subject to the initial conditions: u = f(x), du/dt = g(x),0<x<latt=0 (2) 
and the boundary conditions: u(0, t) = P(t), u(1, t) = p(t) (3) 


Consider a rectangular mesh in the x-t plane spacing h along x direction 
and k along time direction. Denoting a mesh point (x, t) = (ih, jk) as simply 
i,j, we have 


2 —s 9, _9, 
ou Y-t; 2Ui41,j d Ou Yj 2Uu; j FU; 41 
- —_ 


ax” i at? h? 
Replacing the derivatives in (1) by their above approximations, we 
obtain 
ck? ‘ 
th = OH, PU = a (us, — Qu, + teas) 
or WG 2(1 — a’c?) u, + wou, , , + Misi) Ue (4) 
where az=k/h. 


Now replacing the derivative in (2) by its central difference approxima- 
tion, we get 
ui, j+1—ui,j-1 _ Ou : 
ok are a 
or u Uy pat 2ke(x) att =0 


ijtl 


Lé., u, =U, _,+ 2kg(x) forj =0 (5) 


4,1 
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Also initial condition u = f(x) at t = 0 becomes ui, —1 = f(x) (6) 

Combining (5) and (6), we have thi = f(x) + 2kg(x) (7) 

Also (3) gives u, a p(t) and u, i Ae 

Hence the Salil form (4) gives the values of u, iagat the (j + 1)th level 
when the nodal values at (j — 1)th and jth levels are known from (6) and (7) 
as shown in Figure 11.31. Thus (4)gives an implicit scheme for the solu- 
tion of the wave equation. 

A special case. The coefficient of u, jin (4) will vanish if ac = lork= 
h/c. Then (4) reduces to the simple fori” 

u...=u...+u.. -u (8) 


ijt i-Lj i+l,j ij-l 


NOTE Obs. 1. This provides an explicit scheme for the solution of 
the wave equation. 

For a = I/c, the solution of (4) is stable and coincides with the 
solution of (1). 

For @ < I/c, the solution is stable but inaccurate. 

For a > I/c, the solution is unstable. 


NOTE Obs. 2. The formula (4) converges for a < Li.e.,k <h. 


tp 
© r’ r r 
w(t) 
p(t) x 
r e @ Ist level 
ws 
ri 
es a o o o 2nd level 
<7 
k 
h >x 
fix) 


FIGURE 11.31 
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EXAMPLE 11.14 


Evaluate the pivotal values of the equation u,, = 16u,, taking Av = lup 
to t = 1.25. The boundary conditions are u(0, t) = u(5, ¢) = 0, ut(x, 0) = 0 and 
u(x, 0) = x?(5 —x). 


Solution: 
Here c? = 16. 
. The difference equation for the given equation is 


= 2 2 ’ 
ag 2(1 — 16a?) ig * 16a (u,,, + Us) 2 3 (i) 


where a@ =k/h. 


Taking h = 1 and choosing k so that the coefficient of u,, vanishes, we 
have 16a? = 1, i.e.,k =h/4 = 1/4. 


*. (1) reduces to hg = Ugg gs, Uy (ii) 


which gives a convergent solution (since k/h < 1). Its solution coincides with 
the solution of the given differential equation. 


Now since u(0, t) =u(5,t)=0, ~. Uy = 0 and = 0 for all values 


of j 
i.e., the entries in the first and last columns are zero. 
7 = a 
Since Ub y= (5 —x) 


u (5 —i) = 4, 12, 18, 16 fori =1, 2,3, 4 att =0. 


PO = 
These are the entries for the first row. 


Finally since u, ,=0 becomes 


(x, 0. 

Migr 7 Hejl = 0, when j = 0, giving u, , =u, 

Qk 

Thus the entries of the second row are the same as those of the first 
row. 


= (iti) 


Putting j = 0 in (ii), 


u +u 


es, O+u 1 Yi +10 


i, 1 


0-4, _ 


or u,,= 1/2 (44 + W410) (iv) 


492 u, ,, using (ii) 


Taking i = 1, 2, 3, 4 successively, we obtain 


Wy = (uy o + Us, s)= (0+12)=6 
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1 1 

uy) 2 Ugg + Ug9) = Ot 2) 6 
1 at 

Ug) — Uy +39) = g(4+18)= 11 
1 1 

U3 1 “9 U9 0 Fy a) = —(12 +16)= 14 
1 1 

Ug “9 39 +Us9) = gl8+0)= 9 


These are the entries of the second row. 


Putting j = 1 in (ii), we get U, =U, tH 1-45 


Taking i = 1, 2, 3, 4 successively, we obtain 


thy p= Uy Py u, =O0+11 4=7 


1,2 

Uy =U, +U,, ue 6+ 14-12=8 
Us, =U, TU, | p= il+9-18=2 
th, pg =U, TF Ug Ug =14+0-16=-2 


These are the entries of the third row. 


Similarly putting j = 2, 3, 4 successively in (ii), the entries of the fourth, 
fifth, and six throws are obtained. 


Hence the values of u, , are as shown in the table below: 


; 0 IL 2 3 4 5 
J 
0 0 4 12 18 16 0 
IL 0 6 11 14 9 0 
2 0 7 8 2 -2 0 
3 0 2 2 8 7 0 
+ 0 -9 -14 -11 -6 0 
5 0 -16 -18 -12 -4 0 


EXAMPLE 11.15 


Solve y,, = y,, up to t = 0.5 with a spacing of 0.1 subject to y(0, t) = 0, 
y(1, t) =0, yt (x, 0) = 0 and y(x, 0) = 10 + x(1—x). 
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Solution: 
As c?=1,h=0.1,k = (h/c) = 0.1; we use the formula 

Mesa = ea 4 as Yay Giga (i) 
Since y(0, t) = 0, y(1, t) = 90, 


U4 0, Vise 0 for all values of i. 


i.e., all the entries in the first and last columns are zero. 
Since y(x,0)=10+x (1-72), -. Y, = 10+i (1 -i) 

Yor 9 = 10.09, Yoo 9 = 10-16, Yay) = 10.21, y,, = 10.24 
Yos.p = 10.25, Yong = 10.24, Yor 9 = 10.21, yy, = 10.16, 
Yoo 9 = 10.09 


These are the entries of the first row. 


Since  y, (x, 0) = 0, we have Vy, 41 — Yi ja) =0 (ii) 
When j= Yi Yi 
Putting j=O0m (i), Yi = Yin. t Yio Yi-1 


Using (i) y= VAY, 1.0 + Yin) 
Taking i = 1, 2, 3 ---, 9 successively, we obtain the entries of the second 


row. 
Putting j = 1 in (i), Yin = Yin t Yi 7 Yio 
Taking i = 1, 2, 3, ---, 9 successively, we get the entries of the third row. 


Similarly putting j = 2, 3, ..., 7 successively in (i), the entries of the 
fourth to ninth row are obtained. Hence the values of u, , are as given in the 
table below: 


IN 0 1 2 3 4 5 6 i 8 9) 10 
0 O {10.19 ]10.16 |10.21 ]10.24 | 10.25 | 10.24) 10.21} 10.16} 10.09} 0 
1 0 5.08 }10.15 |10.20 |10.23 | 10.24 | 10.23 | 10.20} 10.15] 5.08 0 
2 0 0.06 | 5.12 |10.17 |10.20 | 10.21 | 10.20 | 10.17 | 10.12 | 0.06 0 
3 0 0.04 | 0.08 | 5.12 ]10.15 | 10.16 | 10.15 | 10.12 | 10.08 | 0.04 0 
4 0 0.02 | 0.04 | 0.06 | 5.08 | 10.09 | 10.08 | 10.16 | 10.04 | 0.02 0 
5 0 0 0 0 0 0 0 0 QO |-0.02| 0 
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EXAMPLE 11.16 


The transverse displacement wu of a point at a distance x from one end 
and at any time t of a vibrating string satisfies the equation C’u/dt? = 40°u/ox’, 
with boundary conditions u = 0 atx = 0,¢ > 0 andu = 0 atx = 4,¢ > 0 and 
initial conditions wu = x(4— x) and du/dt = 0, 0 <x < 4. Solve this equation 
numerically for one-half period of vibration, taking h = 1 andk = 1/2. 

Solution: 

Here, h/k =2=c. 


.. The difference equation for the given equation is 


1 ag Mig (i) 
which gives a convergent solution (since k < h). 
Now since u(0, t) =u(4, t) = 0, 
Uy = 0 and u4, j = 0 for all values of /. 
Leé., the entries in the first and last columns are zero. 
Since U4. o) = x(4 —x), 
u, »=i(4 —i) =3,4,3 fori=1,2,3att=O0. 
These are the entries of the first row. 
Also u,(x, 0) = 0 becomes 
a =0 whenj =0, giving u, =U, , (ii) 
Putting j = 0 in (i), WU ot Ua oY, 1 = 4 ot Yao 4, » Using (ii) 
or u,,= 1/2 Cane + U4 @) (iii) 


Taking i = 1, 2, 3 successively, we obtain 
u,,=1/2 (uy + tt, 9) =2;u, ,=1/2 (14, tU 5) 
=3,u,,=1/2(u, + uy o) =2 
These are the entries of the second row. 
Putting j = 1 in (i), u,,=u,,1l+u,,1l—4,, 


Taking i = 1, 2, 3, successively, we get 


i, Uy Uy u, ,=O+3 3=0 
Ue p= Uy FU 4 Uy p= 2t2 4=0 


U, =U, +, Uz, ,=3+0 3=0 
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These are the entries of the third row and so on. 
Now the equation of the vibrating string of length / isu, =c?w,,. 


Ql 2x4 
. Its period of vibration —= “he 4sec [ l=4andc=2] 
‘ : 


This shows that we have to compute u a1) Up tot=2 
i.e. Similarly we obtain the values of u, , (fourth row)and u, , (fifth row). 


Hence the values of u, ,are as shown in the next table: 


: 0 1 2 3 4 
J 
0 0 3 4 3 0 
1 0 2 3 2 0 
2 0 0 0 0 0 
3 0 2 3 2 0 
4 0 =3 -4 =3 0 


EXAMPLE 11.17 


Find the solution of the initial boundary value problem: 


eu a 

= aa 0 <x <1; subject to the initial conditions u(x, 0) = sin zx, 
x 

O<x<1, (= (x, 0) = 0, 0 <x < 1 and the boundary conditions u (0, t) = 0, 
ot 


u(1, t) = 0, t > 0; by using in the (a) the explicit scheme (b) the implicit 
scheme. 


Solution: 
(a) Explicit scheme 
Take h = 0.2, k = h/c =0.2 le c=1] 


-. We use the formulauw,. ,=u., .+u..,.-Uu.. (i) 
ij+1 i-l,j i+l,j i,j-l 


Since u(0, t) = 0, u(1, t) =0, u 


9, =0,uU, ,=0 for all values of j 
oJ Lj 

i.e., the entries in the first and last columns are zero. 

Since u(x, 0) = sin mx, u,, = sin mx 


U,,=0, uy, = sin (.27¢) = 0.5878, u,, = sin (47) = 0.9511, 
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u,,= sin (.67r) = 0.5878. 
These are the entries of the first row. 


Since u,(x, 0) = 0 we have Vu, 441 - u, 1) = 0, when j = 0 
ieé., u,, =U, (ii) 


Putting j = 0 in (i), U1 =U ot Yar 0-441 


Using (ii) u,, = 1/2(u,,,+u 


eae 


Taking i = 1, 2, 3, 4 successively, we obtain the entries of the second 
row. 

Putting j= lin (i),u,,= Te 

Now taking i = 1, 2, 3, 4 successively, we get the entries of the third row. 


Similarly taking j = 2, j = 3, j = 4 successively, we obtain the entries of 
the fourth, fifth, and sixth rows, respectively. 


Hence the values of u, are as given in the table below: 


: : 0 I 9) 3 4 5) 
f 

0 0 0.5878 0.9511 0.9511 0.5878 0 

1 0 0.4756 0.7695 0.9511 0.7695 0 

9) 0 0.1817 0.4756 0.5878 0.3633 0 

3 0 0 0.0001 | —0.1122 | —0.1816 0 

4 0 —0.1816 | — 0.5878 | — 0.7694 | 0.4755 0 

5 0) — 0.5878 | — 0.9511 | — 0.9511 | — 0.5878 0 
(b) Implicit scheme 
We have the formula: 
th = 2 (1 -—a’c?) a ac? (us, + Us ;) th og where @ = k/h. (i) 
Here c? = 1, Take h = 0.25 andk = 0.5 so that a =k/h = 2. 

*. (i) reduces to 

A a 6u, , +4 (U4, + Us; at (ii) 

Since u(i,O) = sin wx 


ty yy = 01071, tt, gy = 0-9, Bg = 0.0071 
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There are the entries of the first row. 
0, we have VY, it — Pe) = 


Yi; 1 =Y; 4 (ii) 
anes j =0 and using (iii), (ii) reduces to 


Since u,(x, 0) = 0, where j = 0 


u,,=-3u,,+2u,, +4, 9) 

Now taking i=lu,,=-3u,,+2 (Wy 9 + Us 9) =—0.1213 
i=2,u,,=-3u, +2 (tu, +u, ,)=— 0.1716 
i=3,u,,=—3u, +2 (UW, +U, 5) =— 0.1213 

These are the entries of the second row. 

Putting j = 1, (ii) reduces to 

=—6u,,+4 (u,_ ig as, “) 

Now taking i=lu,,=-6u,,+4 (ig at uy ,) =0.414 
i=2,u,,=—-6u,,+4 (u, 1 iy ) = 0.0592 
i=3,u,,=—6u,,+4 (us +u, ) = 0.0414 

These are the entries of the third row. 

Putting j = 2, (ii) reduces to 

u,,=—6u,,,, (U, ee 5) — ui, 

Now taking i=l,u,, 7 srg hg. gy, p= = 0.1097 
i=2,u,, =—6u,,,,(u, s ru, a _ = 9.1476 
i=3, u,,=—6u,,, (u, gt tly 7 = 0.1097 

These are the entries of the fourth row. 

Hence the values of u, , are as tabulated below: 

i 0 il 2 o 4 
fl 
0 0 0.7071 0.5 0.7071 0) 
Il 0 — 0.1213 | —0.1716 | —0.1213 
2 0 0.0414 0.0592 0.0414 0 
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EXERCISES 11.5 


1. Solve the boundary value problem u,, = u,, with the conditions u(0, t) = 
u(1, t) =0, u(x, 0) = 1/2 x(1—x) and ui(x, 0) =0, taking h =k =0.1 for 0 <t 
< 0.4. Compare your solution with the exact solution at x = 0.5 and t = 0.3. 


2. The transverse displacement of a point at a distance x from one end and 
ey hese ek _ dus. du 
at any time ¢ of a vibrating string satisfies the equation oa re with 
x 
the boundary conditions w(0,t) = u(5, t) = 0 and the initial conditions 
20x for0<xX <1 
u(x, 0) = 


and u,(x, 0) =0. Solve this equation nu- 
5(5—x«)forlsx <5 


merically for one-half period of vibration, taking h = 1, k = 0.2. 
3. The function uw satisfies the equation ve = ou and the conditions: u(x, 
0) = 1/8 sin ax,u,(x, 0) =0 for 0 <x <1, u(0, t= u(1,t)=0 fort > 0. 
Use the explicit scheme to calculate wu for x = 0(0.1) 1 and t = 0(0.1) 0.5. 
4. Solve a ry ,0<x<1,t>0, given u(x, 0) =u, (x, 0) =u(0, 1) =0 and 
u (1, t) ‘ ee at. Compute u for four times with h = 0.25. 


EXERCISES 11.6 


1. Which of the following equations is parabolic: 
(a) ff, =0 (b) fy + fy + Foy = 9 Ce ie ee ee 


2.u,=V4(u,,,,-u,_,, +4, 
ij i+ i-Lj 


.,-U,,_,) is Leibmann’s five-point formula. 
a! ij-1 


Lj 
(True or False) 


-U,, + 3u,, +4,, = 0 is classified as --- . 

. Wu =fix, y) is known as --- . 

. The simplest formula to solve u,=@? u, is +++... 
. The finite difference form of 07u/6x? is ---.. 


. Schmidt’s finite difference scheme to solve u,=c* u,, is --- 


on Da a kk Ww 


. The five point diagonal formula gives Uy = ves : 


13. 


14. 
15. 


16. 
17. 


18. 2 


19. 


20. 


21. 


22. 
23. 


24. 
25. 


26. 


27. 
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. The partial differential equation (x + 1) u,, — 2(x + 2) u,, + (x +3) U= 0 
is classified as---.. - 
.u...,=1/2(u..,.+u,,.)is called ---.. recurrence relation. 


ij+1 i+lj lal | 


. In terms of difference quotients du =u, is---. 


. The Bendre-Schmidt recurrence relation for one dimensional heat 


equation is ..... 5 


The diagonal five point formula to solve the Laplace equation wu. + Uy = 
Ois..... . 


The Crank-Nicholson formula to solve u,, = au, when k = ah’, is ..... . 


In the parabolic equation u, = @ u, ifA =ka*/h?, where k = At, and h = 
Ax, then explicit method is stable if4 =..... . 


The Bendre-Schmidt recurrence scheme is useful to solve ..... equation. 


The two methods of solving one-dimensional diffusion (heat) equation 
are... 
au au a°u 


ax” dxoy ay” 


=0 is classified as... . 
The order of error in solving Laplace and Poisson’s equations by finite 
difference method is --- . 


The difference scheme for solving the Poisson equation Vu = f(x, y) 
iS... 


The explicit formula for one-dimensional wave equation with 1 — Aa? = 


OandA=Kk/his---. 
The general form of Poisson’s equation in partial derivatives is --- . 


If u satisfies Laplace equation and u = 100 on the boundary of a square, 
the value of u at an interior grid point is --- . 


The Laplace equation u,,+U,, = 0 in difference quotients is --- . 


The equation yu. + Uy, = 0 is hyperbolic in the region --- . 
du leu ; : 
To solve a ae by the Bendre-Schmidt method with h = 1, the 
ui 2 ax” 


value of kis -:-. 


Crank Nicholson’s scheme is called an implicit scheme because --- . 
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12.1. Introduction 


We often face situations where decision making is a problem of plan- 
ning activity. The problem generally, is of utilizing the scarce resources in 
an efficient manner so as to maximize the profit or to minimize the cost or 
to yield the maximum production. Such problems are called optimization 
problems. Linear programming in particular, deals with the optimization 
(maximization or minimization) of linear functions subject to linear con- 
straints. This technique was propounded by George B. Dantzig in 1947 
while working on a project for the U.S. Air Force. He also developed a 
powerful iterative process known as the “simplex method” for solving linear 
programming problems in 1951. 


Linear programming is widely used to tackle a number of industrial, 
economic, marketing, and distribution problems. This technique has found 
its applications to important areas of product mix, blending problems, and 
diet problems. Oil refineries, chemical industries, steel industries, and food 
processing industry are also using linear programming with considerable 
success. In defense, this technique is being employed in inspection, optimal 
bombing patterns, design of weapons, etc. In fact, linear programming may 
be applied to any situation where a linear function of variables has to be 
optimized subject to a set of linear equations or inequalities. 


In this chapter, our purpose is to present the principles of linear pro- 
gramming and the techniques of its application in a manner that will suit 
both engineers and scientists who are increasingly using this technique to 
solve their problems. Beginning with the graphical method which provides 
a great deal of insight into the basic concepts, the simplex method of solving 
linear programming problems is developed. Then the reader is introduced 
to the duality concept. Finally a special class of linear programming prob- 
lems namely: transportation and assignment problems, is taken up. 


12.2 Formulation of the Problem 


To begin with, a problem is to be presented in a linear programming 
form which requires defining the variables involved, establishing relation- 
ships between them, and formulating the objective function and the con- 
straints. We illustrate this through a few examples, wherein the stress will 
be on the analysis of the problem and formulation of the linear program- 
ming model. 
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EXAMPLE 12.1 


A manufacturer produces two types of models M, and M,. Each M, 
model requires 4 hours of grinding and 2 hours of polishing; whereas each 
M, model requires 2 hours of grinding and 5 hours of polishing. The manu- 
facturer has 2 grinders and 3 polishers. Each grinder works for 40 hours a 
week and each polisher works for 60 hours a week. Profit on an M, model is 
$ 3 and on an M, model is $ 4. Whatever is produced in a week is sold in the 
market. How should the manufacturer allocate his production capacity to 
the two types of models so that he may make the maximum profit in a week 


Solution: 


Let x, be the number of M, models and x,, the number of M, models 
produced per week. Then the weekly profit (in $) is 
Z = 3x, + 4x, (i) 
To produce these number of models, the total number of grinding 
hours needed per week 


= 4x, + 2x, 
and the total number of polishing hours required per week 
= 2x, + OX, 


Since the number of grinding hours available is not more than 80 and 
the number of polishing hours is not more than 180, therefore 


Ax + 2x, < 80 (ii) 
2x, + 5x, < 180 (iii) 
Also since the negative number of models are not produced, obviously 
we must have 
x,20andx, 20 (iv) 
Hence this allocation problem is to find x,, x, which 
Maximize Z=3x, +4, 
subjectto 4x, + 2x, < 80, 2x, + 5x, < 180, x,, x, 20. 


Obs. The variables that enter into the problem are called 
NOTE - ‘ 

__~ decision variables. 

The expression (i) showing the relationship between the 
manufacturer's goal and the decision variables, is called the 
objective function. 


The inequalities (ii), (iii), and (iv) are called the constraints. 
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The objective function and the constraints being all linear, it is a linear 
programming problem(L.P.P.). This is an example of a real situation from 


industry. 


EXAMPLE 12.2 


Consider the following problem faced by a production planner in a 
soft-drink plant. He has two bottling machines A and B. A is designed for 
8-ounce bottles and B for 16 ounce bottles. However, each can be used on 
both types with some loss of efficiency. The following is available: 


Machine 8-ounce bottles 16-ounce bottles 
A 100/minute 40/minute 
B 60/minute 75/minute 


The machines can be run 8 hours per day, 5 days per week. Profit in a 
8-ounce bottle is 15 paise and on a 16-ounce bottle is 25 paise. Weekly pro- 
duction of drink cannot exceed 300,000 ounces and the market can absorb 
25,000 8-ounce bottles and 7,000 16-ounce bottles per week. The planner 
wishes to maximize his profit subject, of course, to all the production and 
marketing restrictions. Formulate this as a linear programming problem. 


Solution: 


Let x, units of 8-ounce bottle and x, units of 16-ounce bottle be pro- 
duced per week. Than the weekly profit (in $) of the production planner is 
Z =0.15x1 + 0.25x, (i) 
Since an 8-ounce bottle takes 1/100 minutes and a 16-ounce bottle 1/40 
minutes on machine A and the machine can run 8 hours per day, 5 days per 
week, i.e., 2400 minutes per week, therefore we have 
1 1 - 
—x, +—x, = 2400 i 
100°! 402 w 
Also since an 8-ounce bottle takes 1/60 minutes and a 16-ounce bottle 
takes 1/75 minutes on machine B which can run for 2400 minutes per week, 
therefore we have 
1 1 
apt t ae%e $2400 (iii) 
As the total weekly production cannot exceed 300,000 ounces, there- 
fore, 
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8x, + 16x, < 300,000 (iv) 


As the market can absorb at the most 25,000, 8-ounce bottles and 7,000, 
16-ounce bottles per week, therefore, 


0 <x, < 25,000 and 0 <x, < 7,000 (v) 


Hence this allocation problem of the production planner is to find x,, 
x, which 


Maximize Z= 0.15x, + 0.25x, 
subject to 2x, + 5x, < 480,000, 5x, + 4x, < 720,000, x, + 2x, < 37,500 
0 <x1 < 25,000 and 0 < x2 < 7,000. 


EXAMPLE 12.3 


A firm making castings uses electric furnace to melt iron with the fol- 
lowing specifications: 


Minimum Maximum 
Carbon 3.20% 3.40% 
Silicon 2.25% 2.35% 


Specifications and costs of various raw materials used for this purpose 
are given below: 


Material Carbon% Silicon % Cost ($) 
Steel scrap 0.4 0.15 850/metric ton 
Cast iron scrap 3.80 2.40 900/metric ton 
Remelt from foundary 3.50 2.30 500/metric ton 


If the total charge of iron metal required is 4 metric tons, find the 
weight in kg of each raw material that must be used in the optimal mix at 
minimum cost. 


Solution: 


Let x,, x,, x, be the amounts (in kg) of these raw materials. The objec- 
tive is to minimize the cost ée., 
850 900 500 
= xX, + Xg + X3 
1000 1000 1000 
For iron melt to have a minimum of 3.2% carbon, 


0.4x,+3.8x,+3.5x, 23.2 x 4,000 (ii) 


(i) 


Minimize Z 
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For iron melt to have a maximum of 3.4% carbon, 


0.4x,+3.8x,+3.5x,< 3.4 x 4,000 (iti 
For iron melt to have a minimum of 2.25% silicon, 

0.15 x, +241 x, + 2.35 x, > 2.25 x 4,000 (iv 
For iron melt to have a maximum of 2.35% silicon, 

0.15 x, +2.41 x, + 2.35 x, < 2.35 x 4,000 (v 


Also, since the materials added up must be equal to the full charge weight 
of 4 metric tons, 


x, +x, +x, = 4,000 (vi) 
Finally since the amounts of raw material cannot be negative 
“20%, > 0 020 (vii) 


Thus the linear programming problem is to find x,, x,, x, which 
Minimize Z=0.85x,+0.9 x, + 0.5 x, 
subject to 0.4%x,+3.8x,+3.5 x, 2 12,800, 0.4%, +3.8x, +3.5 x, < 13,600 


0.15 x, + 2.41 x, + 2.35 x, > 9,000, 0.15 x, + 2.41 x, + 
2.35 x, < 9,400 


x, a, o, = 4,000, x, x. 4,2 0. 


Exercises 12.11 


1. A firm manufactures two items. It purchases castings which are then ma- 
chined, bored, and polished. Castings for items A and B cost $3 and $ 4 
each and are sold at $ 6 and $ 7 each, respectively. Running costs of these 
machines are $ 20, $ 14, and $17.50 per hour, respectively. Formulate 
the problem so that the product mix maximizes the profit. Capacities of 
the machines are 


Part A Part B 
Machining capacity 25 per hr. 40 per hr. 
Boring capacity 28 per hr. 35 per hr. 
Polishing capacity 35 per hr. 25 per hr. 


2. A firm manufactures 3 products A, B, and C. The profits are $3, $ 2, 
and § 4, respectively. The firm has two machines M, and M, and below 
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is the required capacity processing time in minutes for each machine on 
each product. 


Product 
Machine A B @ 
M, 4 3 5 
M, 2 2 4 


Machines M, and M, have 2000 and 2500 machine-minutes respectively. 
The firm must manufacture 100 A’s, 200 B’s and 50 C’s but not more 
than 150 A’s. Set up an L.P.P. to maximize profit. 


. Three products are processed through three different operations. The 
time (in minutes) required per unit of each product, the daily capacity of 
the operations (in minutes per day), and the profit per unit sold for each 
product (in Dollars) are as follows: 


Time per unit eration 
Cree Product I Product II Product UI oe 
1 3 4 3 42 
2 5 0 3 45 
3 3 6 2) Al 
Profit ($) 3 2 al 


The zero time indicates that the product does not require the given op- 
eration. The problem is to determine the optimum daily production for 
three products that maximize the profit. Formulate this production plan- 
ning problem as a linear programming problem assuming that all units 
produced are sold. 


. An aeroplane can carry a maximum of 200 passengers. A profit of $ 400 
is made on each first class ticket and a profit of $ 300 is made on each 
economy class ticket. The airline reserves at least twenty seats for first 
class. However, at least four times as many passengers prefer to travel 
by economy class than by the first class. How many tickets of each class 
must be sold in order to maximize profit for the airline? Formulate the 
problem as an L.P. model. 


. A firm manufactures headache pills in two sizes A and B. Size A con- 

tains 2 grains of asprin, 5 grains of bicarbonate, and 1 grain of codeine. 
Size B contains | grain of asprin, 8grains of bicarbonate and 6 grains of 
codeine. It is found by users that it requires at least 12 grains of asprin, 
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74 grains of bicarbonate, and 24 grains of codeine for providing immedi- 
ate effect. It is required to determine the least number of pills a patient 
should take to get immediate relief. Formulate the problem as a stan- 
dard L.P.P. 


6. A dairy feed company may purchase and mix one or more of three types 
of grains containing different amounts of nutritional elements. The 
data is given in the table below. The production manager specifies that 
any feed mix for his live stock must meet at least minimum nutritional 
requirements and seeks the least costly among all three mixes. 


One unit weight of Minimum 
em é 
Grain | Grain 2 Grain 3 requirement 
A 2 3 4 1,250 
Nutritional B 1 1 0 250 
Ingredients C 5 3 0 900 
» 6 25 1 239.5 
Cost per weight of Al 35 96 


Formulate the problem as a L.P. model. 
7. A firm produces an alloy with the following specifications: 
(i) specific gravity < 0.97 
(ii) chromium content > 15% 
(iii) melting temperature = 494°C 


The alloy requires three raw materials A, B, and C whose properties are 


as follows: 
Properties of raw material 
Property 
A B Cc 
Sp. gravity 0.94 1.00 1.05 
Chromium 10% 15% 17% 
Melting pt. 470°C 500°C 520°C 


Find the values of A, B, C to be used to make | meric ton of alloy of 
desired properties, keeping the raw material costs at the minimum when 
they are $ 105/metric ton for A, $ 245/metric ton for B and $ 165/ metric 
ton for C. Formulate an L.P. model for the problem. 


8. The owner of Metro sports wishes to determine how many 
advertisements to place in the selected three monthly magazines A, B, 
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and C. His objective is to advertise in such a way that total exposure to 
principal buyers of expensive sports goods is maximized. Percentages of 
readers for magazine are known. Exposure in any particular magazine 
is the number of advertisements placed multiplied by the number of 
principal buyers. The following data may be used: 


Magazine 
A B ¢ 
Readers 1 lakh 0.6 lakh 0.4 lakh 
Principal buyers 10% 15% 7% 
Cost per advertisement ($) 5000 4500 4250 


The budgeted amount is at most $100,000 for advertisements. The own- 
er has already decided that magazine A should have no more than six 
advertisements and that B and C each have at least two advertisements. 
Formulate an L.P. model for the problem. 


12.3. Graphical Method 


Linear programming problems involving only two variables can be ef- 
fectively solved by a graphical technique. In actual practice, we rarely come 
across such problems. Even then, the graphical method provides a pictorial 
representation of the solution and one gets ample insight into the basic 
concepts used in solving large L.P.P. 


Working procedure to solve a linear programming problem graphically: 
Step 1. Formulate the given problem as a linear programming problem. 


Step 2. Plot the given constraints as equalities on x ,x,-coordinate plane and 
determine the convex region* formed by them. 


Step 3. Determine the vertices of the convex region and find the value of 
the objective function at each vertex. The vertex which gives the optimal 
*A region or a set of points is said to be convex if the line joining any two of its points lies completely 
in the region (or the set). Figures 12.1 and 12.2 represent convex regions while Figures 12.3 and 12.4 
do not form convex sets. 


Came 


FIGURE 12.1 FIGURE 12.2 FIGURE 12.3 FIGURE 12.4 
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(maximum or minimum) value of the objective function gives the desired 
optimal solution to the problem. 


Otherwise. Draw the dotted line through the origin representing the ob- 
jective function with Z = 0. As Z is increased from zero, this line moves to 
the right remaining parallel to itself. We go on sliding this line (parallel to 
itself), till it is farthest away from the origin and passes through only one 
vertex of the convex region. This is the vertex where maximum value of Z 
is attained. 

When it is required to minimize Z, the value of Z is increased until the 
dotted line passes through the nearest vertex of the convex region. 


EXAMPLE 12.4 


Solve the L.P.P. of Example 12.1 graphically. 


Solution: 
The problem is: 
Maximize Z=3x,+4, (i) 
subject to 4x, + 2x, < 80 (ii) 
2x, + 5x, < 180 (iii) 
pce ae (iv) 


Consider the x,x,-coordinate system as shown in Figure 12.5. The non-neg- 
ativity restrictions (iv) imply that the values of x,, x, lie in the first quadrant 
only. 


We plot the lines 4x, + 2x, = 80 and 2x, + 5x, = 180. 


gency. 


FIGURE 12.5 


Then any point on or below 4 x, + 2x, = 80 satisfies (ii) and any point on 
or below 2.x, + 5x, = 180 satisfies (iii), This shows that the desired point (x,, 
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x,) must be somewhere in the shaded convex region OABC. This region is 
called the solution space or region of feasible solutions for the given prob- 
lem. Its vertices are O(0,0), A(20, 0), B(2.5, 35), and C(0, 36). 


The values of the objective function (i) at these points are 
Z(O) = 0, Z(A) = 60, Z(B) = 147.5, Z(C) = 144. 


Thus the maximum value of Z is 147.5 and it occurs at B. Hence the 

optimal solution to the problem is 
x,=2.5,x%,=85andZ = 147.5. 

Otherwise. Our aim is to find the point in the solution space which maxi- 
mizes the profit function Z. To do this, we observe that on making Z = 0, (i) 
becomes 3x, + 4x, = 0 which is represented by the dotted line LM through 
O. As the value of Z is increased, the line LM starts moving parallel to itself 
towards the right. larger the value of Z, more will be the company’s profit. 
In this way, we go on sliding LM until it is farthest away from the origin and 
passes through one of the corners of the convex region. This is the point 
where the maximum value of Z is attained. Just possibly, such a line may be 
one of the edges of the solution space. In that case every point on that edge 
gives the same maximum value of Z. 


Here Z,. is attained at B(2.5, 35). Hence the optimal solution is 


max 


x, =2.5,x,=35 and Z = 147.5. 


EXAMPLE 12.5 
Find the maximum value of Z = 2x + 3y 


Subject to the constraints: x + y < 30, y = 3,0 <y < 12, x—y 2 0, and 
O<x < 20. 


Solution: 


Any point (x, y) satisfying the conditions x = 0, y = 0 lies in the first 
quadrant only. Also since, 


x+y $30, y23,y <12,x2y andx < 20, the desired point (x, y) lies 
within the convex region ABCDE (shown shaded in Figure 12.6). Its verti- 
ces are A(3, 3), B (20, 3), C(20, 10), D(18, 12) and E(12, 12). 


The values of Z at these five vertices are Z(A) = 15, Z(B) = 49, 
Z(C) = 70, Z(D) = 72, and Z(E) = 60. 


Since the maximum value of Z is 72 which occurs at the vertex D, the 
solution to the L.P.P. is 


x = 18, y = 12 and maximum Z = 72. 


> x 


FIGURE 12.6 


EXAMPLE 12.6 


A company manufactures two types of cloth, using three different co- 
lours of wool. One yard length of type A cloth requires 4 0z of red wool, 5 
oz of green wool and 3 oz of yellow wool. One yard length of type B cloth 
requires 5 oz of red wool, 2 0z of green wool and 8 oz of yellow wool. The 
wool available for manufacture is 1000 oz of red wool, 1000 oz of green 
wool and 1200 oz of yellow wool. The manufacturer can make a profit of $ 
5 on one yard of type A cloth and $ 3 on one yard of type B cloth. Find the 
best combination of the quantities of type A and type B cloth which gives 
him maximum profit by solving the L.P.P. graphically. 


Solution: 


Let the manufacturer decide to produce x, yards of type A cloth and x, 
yards of type B cloth. Then the total income in dollars, from these units of 
cloth is given by 

Z=5x,+ 8x, (i) 

To produce these units of two types of cloth, he requires 

red wool = 4x, + 5x, 0z, green wool = 5.x, + 2x, 02, 
and yellow wool = 3x, + 8x, oz. 


Since the manufacturer does not have more than 1000 oz of red wool, 
1000 oz of green wool and 1200 oz of yellow wool, therefore 
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4x + 5x, < 1000 (ii) 

5x, + 2x, < 1000 (iii) 

3x, + 8x, < 1200 (iv) 

Also 20.5. 20 (v) 
Thus the given problem is to maximize Z subject to the constraints (ii) 


to (v). 


Any point satisfying the condition (v) lies in the first quadrant only. 
Also the desired point satisfying the constraints (ii) to (iv) lies in the convex 
region OABCD (Figure 12.7). Its vertices are O(0, 0), A(200, 0), B(3000/17, 
1000/17), C(2000/17, 1800/17), and D(0,150). 


The values of Z at these vertices are given by Z(O) = 0, Z(A) = 1000, 
Z(B) = 1057.6, Z(C) = 905.8 and Z(D) = 450. 


O A 
FIGURE 12.7 
Since the maximum value of Z is 1058.8 which occurs at the vertex B, 
the solution to the given problem is 
x, = 3000/17, x, = 1000/17 and max. 
Z = 1058.8. 


Hence the manufacturer should produce 176.5 yards of type A cloth 
58.8 yards of type B cloth, so as to get the maximum profit of $ 1058.8. 


(ii) ; 
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EXAMPLE 12.7 


A company making cold drinks has two bottling plants located at towns 
T, and T,. Each plant produces three drinks A, B, and C and their produc- 
tion capacity per day is shown below: 


Plant at 
Cold drinks r, T, 
A 6,000 2,000 
B 1,000 2,500 
G 3,000 3,000 


The marketing department of the company forecasts a demand of 
80,000 bottles of A, 22,000 bottles of B and 40,000 bottles of C during the 
month of June. The operating costs per day of plants at T, and T, are $ 6,000 
and $ 4,000 respectively. Find (graphically) the number of days for which 
each plant must be run in June so as to minimize the operating costs while 
meeting the market demand. 


Solution: 


Let the plants at T, and T, be run for x, and x, days. Then the objective 
is to minimize the operation costs, i.é., 


min. Z = 6000 x, + 4000x, (i 

Constraints on the demand for the three cold drinks are: 
for A, 6,000 x, + 2,000x, 2 80,000 or 3.x, +x, 240 (ii 
for B, 1,000 x, + 2,500x, = 22,000 or x, + 2.5%, = 22 (iti 
for C, 3,000 x, + 3,000x, = 40,000 or x, + x, = 40/3 (iv 
Also pe ee (v 


Thus the L.P.P. is to minimize (i) subject to constraints (ii) to (v). 


The solution space satisfying the constraints (ii) to (v) is shown shaded 
in Figure 12.8. As seen from the direction of the arrows, the solution space 
is unbounded. The constraint (iv) is dominated by the constraints (ii) and 
(iii) and hence does not affect the solution space. Such a constraint as (iv) 
is called the redundant constraint. 


The vertices of the convex region ABC are A(22, 0), B(12, 4), and C(0, 
AO). 
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\ 
M 


FIGURE 12.8 
Values of the objective function (i) at these vertices are 
Z(A) = 132,000, Z(B) = 88,000, Z(C) = 160,000. 
Thus the minimum value of Z is $ 88,000 and it occurs at B. Hence the 
solution to the problem is 


x, = 12 days, x, = 4 days, Z_, = $ 88,000. 
Otherwise. Making Z = 0, (i) becomes 3 x, + 2x, = 0 which is represented 
by the dotted line LM through O. As Z is increased, the line LM moves par- 
allel to itself, to the right. Since we are interested in finding the minimum 
value of Z, value of Z is increased until LM passes through the vertex near- 
est to the origin of the shaded region, i.e., B(12, 4). 


Thus the operating cost will be minimum for x, = 12 days, x, = 4 days, 
and Z . =6000 x 12 + 4000 x 4= $ 88,000. 


min 


Obs. The dotted line parallel to the line LM is called the iso-cost 
line since it represents all possible combinations of x,, x, which 
produce the same total cost. 


NOTE 
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12.4 Some Exceptional Cases 


The constraints generally, give a region of feasible solution which may 
be bounded or unbounded. In problems involving two variables and having 
a finite solution, it was observed that the optimal solution existed at a vertex 
of the feasible region. In fact, this is true for all L.P. problems for which 
solutions exist. Thus it may be stated that if there exists an optimal solution 
of an L.P.P., it will be at one of the vertices of the solution space. 

In each of the above examples, the optimal solution was unique. But it 
is not always so. In fact, L.P.P. may have 

(i) a unique optimal solution, 
or (ii) an infinite number of optimal solutions, 
or (iii) an unbounded solution, 
or (iv) no solution. 


Below are a few examples to illustrate the exceptional cases (ii) to (iv). 


EXAMPLE 12.8 


A firm uses milling machines, grinding machines, and lathes to produce 
two motor parts. The machining times required for each part, the machin- 
ing times available on different machines and the profit on each motor part 
are given below: 


Machining time reqd. for the motor Max. time 
Type of machine part (mts) available per week 
il I (minutes) 
Milling machines 10 4 2,000 
Grinding machines 3 2 900 
Lathes 6 12 3,000 
Profit/unit ($) 100 40 


Determine the number of parts I and II to be manufactured per week to 
maximize the profit. 


Solution: 


Let x,, x, be the number of parts I and II manufactured per week. Then 
objective being to maximize the profit, we have 


maximize Z= 100x, + 40x, (i) 
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Constraints being on the time available on each machine, we obtain 


for milling machines, 10x, + 4x, < 2,000 (ii) 
for grinding machines, 3x, + 2x, < 900 (iii) 
for lathes, 6x, + 12x, < 3,000 (iv) 
Also to 20 (v) 


Thus the problem is to determine x,, x, which maximize (i) subject to 
the constraints (ii) to (v). 

The solution space satisfying (ii), (iii), (iv) and meeting the non-nega- 
tivity restrictions (v) is shown shaded in Figure 12.9. 


> 
Oo. 100 200 300 400 500 x 
\ 


FIGURE 12.9 
Note that (iii) is a redundant constraint as it does not affect the solution 
space. The vertices of the convex region OABC are 
O(0, 0), A(200, 0), B(125, 187.5), C(0, 250). 
Values of the objective function (i) at these vertices are 
Z(O) = 0, Z(A) = 20,000, Z(B) = 20,000 and Z(C) = 10,000 
Thus the maximum value of Z occurs at two vertices A and B. 
.. Any point on the line joining A and B will also give the same maxi- 


mum value of Z i.e., there are an infinite number of feasible solutions which 
yield the same maximum value of Z. 
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Thus there is no unique optimal solution to the problem and any point 
on the line AB can be taken to give the profit of $ 20,000. 


NOTE Obs. An L.P.P. having more than one optimal solution, is said 

—_ to have alternative or multiple optimal solutions. It implies 
that the resources can be combined in more than one way to 
maximize the profit. 


EXAMPLE 12.9 


Using graphical method, solve the following L.P.P: 


Maximize Z = 2x, + 3x, (i) 
subject to x,—-x, 52 (ii) 
sO ee (iti) 
020 (iv) 

Solution: 


Consider x,x, coordinate system. Any point (x,, x,) satisfying the restric- 
tions (iv) lies in the first quadrant only. The solution space satisfying the 


constraints (ii) and (iii) is the convex region shown shaded in Figure 12.10. 


FIGURE 12.10 
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Here the solution space is unbounded. The vertices of the feasible re- 
gion (in the finite plane) are A(3, 1) and B(0, 4). 


Values of the objective function (i) at these vertices are Z(A) = 9 and 
Z(B) = 12. 


But there are points in this convex region for which Z will have much 
higher values. For instance, the point (5, 5) lies in the shaded region and 
the value of Z thereafter is 12.5. In fact, the maximum value of Z occurs at 
infinity. Thus the problem has an unbounded solution. 


EXAMPLE 12.10 


Solve graphically the following L.P.P: 


Maximize Z = 4x, + 3x, (i) 

subject to x,-x,<-1, (ii) 

—x, +x, <0, (iii) 

And iia), (iv) 
Solution: 


Consider x,x,-coordinate system. Any point (x,, x,) satisfying (iv) lies in 
the first quadrant only. The two solution spaces, one satisfying (ii) and the 
other satisfying (iii) are shown in Figure 12.11. 


0 
FIGURE12.11 


There being no point (x,, x,) common to both the shaded regions, the 
problem cannot be solved. Hence the solution does not exist since the 
constraints are inconsistent. 
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Obs. The above problem had no solution because the 
NOTE ; ; 
constraints were incompatible. There may be cases in which the 
constraints are compatible but the problem may still have no 
feasible solution. 


This is an example of insoluble programming problems. At times, manage- 
ment sets such goals which are unattainable within the available resourc- 
es for a number of reasons. Such exceptional management problems are 
solved with the help of “Goal Programming Technique” which has recently 


been developed. 


Exercises 12.2 


Using the graphical method, solve the following L.P. problems: 


1. Max. Z=5x, + 3x, 
subject to 3x, + 5x, < 15 
5x, + 2x, < 10 
Lt 20) 
2. Max. Z=5x, + 7x, 
subject tox, +x, <4, 
5x, + 8x, < 24, 
0K 1n = 30 and t=O, 
3. Min. Z= 20x, + 10x, 
subject to x, + 2x, < 40 
ot, +x, = 30 
4x + 3x, 2 60 and x,, x, 20 
4, Max. Z = 120x, + 100x, 
subject to 10x, + 5x, < 80 


6x, + 6x, < 66 
Ax, + 8x, 2 24 
5x, + 6x, < 90 andx,, x, 2 0. (x, ,x5)|%1 + %2 $50 
x, + 2x, <80 
5. Ifx,, x, are real, show that the set S = is a convex 
: 2x, +x_ 2 20 
X1.X, 20 


set. Find the extreme points of this set. Hence solve L.P.P. (graphically): 
Maximize Z = 4x, + 3x, subject to constraints given in S. 
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6. A firm manufactures two products A and B on which the profits earned 
per unit are $3 and § 4, respectively. Each product is processed on two 
machines M, and M,. Product A requires one minute of processing time 
on M, and 2 tnirntes on M, while B requires one minute on M, and one 
fniniite on M,. Machine M, is available for not more than 7 hours and 
30 minutes while M, is available for 10 hours during any working day. 
Find the number af; units of products A and B to be manufactured to get 
maximum profit. 


7. Two spare parts X and Y are to be produced in a batch. Each one has to 
go through two processes A and B. The time required in hours per unit 
and total time available are given below: 


xe Yi Total hours available 
Process A 3 4 24 
Process B 9 4 36 


Profit per unit of X and Y are $5 and $ 6 respectively. Find how many 
number of spare parts of X and Y are to be produced in this batch to 
maximize the profit. (Each batch is complete in all respects and one can- 
not produce fractional units and stop the batch). 


8. A manufacturer has two products I and I both of which are made in 
steps by machines A and B. The process times per hundred for the two 
products on the two machines are: 


Product Mic. A Mic. B 
I 4 hrs. 5 hrs. 
Il 5 hrs. 2 hrs. 


Set-up times are negligible. For the coming period machine A has 100 
hrs. and B has 80 hrs. The contribution for product I is $ 10 per 100 units 
and for product II is $ 5 per 100 units. The manufacturer is in a market 
which can absorb both products as much as he can produce for the im- 
mediate period ahead. Determine graphically, how much of products I 
and II, he should produce to maximize his contribution. 


9. Two grades of paper M and N are produced on a paper machine. 
Because of raw material restrictions not more than 400 metric tons of 
grade M and 300 metric tons of grade N can be produced in a week. It 
requires 0.2 and 0.4 hours to produce a metric ton of products M and N 
respectively, with corresponding profits of $ 20 and $ 50 per metric ton. 
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10. 


11. 


12. 


It is given that there are 160 hours in a week. Formulate the problem as 
an L.P.P. and determine the optimum product mix. 


A production manager wants to determine the quantity to be produced 


per month of products A and B manufactured by his firm. The data on 
resources required and availability of resources are given below: 


Requirements Available per 
Resources 
Product A Product B month 
Raw material (kg) 60 120 12,000 
Machine hrs/piece 8 5 600 
Assembly man hrs. 3 4 500 
Sale price/piece $ 30 $ 40 


Formulate the problem as a standard L.P.P. Find product mix that would 
give maximum profit by graphical technique. 

A pineapple firm produces two products: canned pineapple and canned 
juice. The specific amounts of material, labor, and equipment required 
to produce each product and the availability of each of these resources 
are shown in the table given below: 


Canned Juice | Pine-apple | Available resources 
Labor (man hrs.) 3 2.0 12.0 
Equipment (m/c hrs) 1 2.3 6.9 
Material (units) 1.4 4.9 


Assuming one unit each of canned juice and canned pineapple has profit 
margins of $2 and $1, respectively. Formulate it as L.P. problem and 
solve it graphically. 

The sales manager of a company has budgeted $ 120,000 for an 
advertising program for one of the firm’s products. The selected 
advertising program consists of running advertisements in two different 
magazines. The advertisement for magazine A costs $ 2,000 per run 
while the advertisement for magazine B costs $ 5,000 per run. Past 
experience has indicated that at least 20 runs in magazine A and at least 
10 runs in magazine B are necessary to penetrate the market with any 
appreciable effect. Also, experience has indicated that there is no reason 
to make more than 50 runs in either of the two magazines. How many 
runs in magazine A and how many in magazine B should be made? 
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Solve the following L.P.P. graphically: 


13. Maximize Z= 3x + 2y 

subject to — 2x + 3y <9, x — 5y 2-20 and x, y = 0. 
14. Maximize Z=x,+ 8x, 

subject to x, + St, S 6, 2,424, <6, 2x, +.4x, 5 6, 


Ate ee ie 0 a ean 0 
15. Minimize Z= 8x, + 12x, 
subject to 60x, + 30x, = 240, 30x, + 60x, = 300, 
30x, + 180x, = 540, and x,, x, 2 0. 
16. G.J. Breveries Ltd. have two bottling plants one located at “G” and other 


“J. Each plant produces three drinks: whiskey, beer, and brandy. The 
number of bottles produced per day are as follows: 


Drink Plant at “G” Plant at “]” 
Whiskey 1,500 1,500 
Beer 3,000 1,000 
Brandy 2,000 5,000 


A market survey indicates that during the month of July, there will be a 
demand of 20,000 bottles of whiskey, 40,000 bottles of beer, and 44,000 
bottles of brandy. The operating cost per day for plants at G and J are 
$ 600 and $ 400. For how many days each plant be run in July so as to 
minimize the production cost, while still meeting the market demand. 
Solve graphically. 


12.5 General Linear Programming Problem 


Any L.P. problem involving more than two variables may be expressed 
as follows: Find the values of the variables x,, x,, ---, x, which maximize (or 
minimize) the objective function 


LEO, FOR, tet Ox (i) 


nn 
subject to the constraints 
041% + AyyXq +++ + Gy nX, SD, 
Agi X + ggXq +++ + dgnX, S dy 


Xn Ss By, 


Am1X Bo AmaX2 ++-+a 


mn 
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and meet the non-negative restrictions. 
tt ee, 20 (iii) 
Def. 1. A set of values x,, x,, -++., x, which satisfies the constraints of the 
L.P.P. is called its solution. 


Def. 2. Any solution to a L.P.P. which satisfies the non-negativity restric- 
tions of the problem is called its feasible solution. 


Def. 3. Any feasible solution which maximizes (or minimizes) the objective 
function of the L.P.P. is called its optimal solution. 


Some of the constraints in (ii) may be equalities, some others may be 
inequalities of (<) type and remaining ones inequalities of (2) type. The 
inequality constraints are changed to equalities by adding (or subtracting) 
non-negative variables to (from) the left-hand side of such constraints. 


Def. 4. If the constraints of a general L.P.P. be 


n 
> ag <b, (§=1,2,---- k) 
jal 
then the non-negative variables s, which satisfy 


> ag, +s, =b,GG=1,2,.-0 k) 
fl 

are called slack variables. 

Def. 5. If the constraints of a general L.P.P. be 


SD) aye, 2, G=RKFL teens ) 
jal 
then the non-negative variables s, which satisfy 
Si ayn; — 5, = b= (Gk kL) 
j=l 
are called surplus variables. 


12.6 Canonical and Standard Forms of L.P.P. 


After the formulation of L.P.P., the next step is to obtain its solution. 
But before any method is used to find its solution, the problem must be 
presented in a suitable form. As such, we explain its following two forms: 
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Canonical form. The general L.P.P. can always be expressed in the fol- 
lowing form: 

Maximize L= Oe Aiea a ie ee a oe 

subject to the constraints 

i Xi Phe, ee bak <b 71 = 1,2, +m 
%.%, en, 

by making some elementary transformations. This form of the L.P.P. is 
called its canonical form and has the following characteristics: 


(i) Objective function is of maximization type, 
(ii) All constraints are of (<) type, 
(iii) All variables x, are non-negative. 


The canonical form is a format for a L.P.P. which finds its use in the 

Duality theory. 

Standard form. The general L.P.P. can also be put in the following form: 
Maximize Z=c,x,+c¢,4,+-+-+¢ x, 
subject to the constraints 
4, X,+4.%, +--+ +4, x =b,;i=1,2,---m 
than 2 0, 

This form of the L.P.P. is called its standard form and has the follow- 
ing characteristics: 
(i) Objective function is of maximization type, 
(ii) All constraints are expressed as equations, 
(iii) Right hand side of each constraint is non-negative, 


(iv) All variables are non-negative. 


NOTE Obs. Any L.P.P. can be expressed in the standard form. 


As minimize Z=c,x, +0, +++ +cx 


2 non 


is equivalent to maximize —_Z’ (= - Z) =-c x, -c,t,...-CX, 
the objective function can always be expressed in the 
maximization form. 


The inequality constraints can always be converted to equalities 
by adding (or subtracting) the slack (or surplus) variables to the 
left hand sides of such constraints. 
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So far, the decision variables x,, x,,-++, x, have been assumed to 
be all non-negative. In actual aes these variables could also 
be zero or negative. If a variable is negative, it can always be 
expressed as the difference of two non-negative variables, e.g., a 


variable x, can be written as 
x =x’ =x.” 
L l u 


where ae 20a” 20, 


EXAMPLE 12.11 
Convert the following L.P.P. to the standard form: 


Maximize Z=3x,+5x,+ 7x,, 


subject to 6x, - Ax, <5, On, +2, ote 2 1, 
Ax, +3, 2. tot, 20: 
Solution: 
As x, is unrestricted, let x, =x,/ — x,” where x,’, x,” 2 0. Now the given 
Ganeee us can be expressed a 
6x, — 4x, <5, 3x, + 2x, + 5x,’ - 5x,” > 11, 


Ag toe, =on, S28, xix nse” 20 


Introducing the slack/surplus variables, the problem in standard form 


becomes: 
Maximize Z=3x, + 5x, + 7x,’ — 7x,” 
subject to 6x, — 4x, +s, =5, 3x, + 2x, + 5x,’ - 5x,” —s, = 11, 


” a uw —— . . , 
Pons 8s TS, Bet es x SoS on Oe <0. 


EXAMPLE 12.12 
Express the following problem in the standard form: 
Minimize Z = 3x, + 4x, 
subject to 2x, -x, — 3x, =-4, 3x, + Sx, +x, = 10, 
x, — 4x, = 12, oe i ee 
Solution: 
Here x,, x, are the slack/surplus variables and Ky: x, are the decision 


variables. As x, is unrestricted, let x, =x,/ — x,” where x,’, x,” 2 0. 
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*. The problem is standard form is 
Maximize Z’ (=-— Z) =-3 x, — 4x,’ + 4x,” 


subjectto -2x,+4x,'-x,"+3x,=4, 3x, + 5x,’ — 5x,” +x, = 10, 
& a a EE ” 
x,— 4x, + 4x," = 12, i, 2 = 0 


12.7 Simplex Method 


While solving an L.P.P. graphically, the region of feasible solutions was 
found to be convex, bounded by vertices and edges joining them. The 
optimal solution occurred at some vertex. If the optimal solution was not 
unique, the optimal points were on an edge. These observations also hold 
true for the general L.P.P. Essentially the problem is that of finding the 
particular vertex of the convex region which corresponds to the optimal 
solution. The most commonly used method for locating the optimal vertex 
is the simplex method. This method consists in moving step by step from 
one vertex to the adjacent one. Of all the adjacent vertices, the one giving 
better value of the objective function over that of the preceding vertex, is 
chosen. This method of jumping from one vertex to the other is then re- 
peated. Since the number of vertices is finite, the simplex method leads to 
an optimal vertex in a finite number of steps. 


In simple method, an infinite number of solutions is reduced to a finite num- 
ber of promising solutions by using the following facts: 


(i) When there are m constraints and m + n (decision and slack) vari- 
ables (m being < n), the starting solution is found by setting n variables 
equal to zero and then solving the remaining m equations, provided the 
solution exists and is unique. The n zero variables are known as non-basic 
variables while the remaining m variables are called basic variables and 
they form a basic solution. This reduces the number of alternatives (basic 
solutions) for obtaining the optimal solution to”*"C__ only. 


(ii) In an L.P.P., the variables must always be non-negative. Some of the 
basic solutions may contains negative variables. Such solutions are called 
basic infeasible solutions and should not be considered. To achieve this, we 
start with a basic solution which is non-negative. The next basic solution 
must always be non-negative. This is ensured by the feasibility condition. 
Such a solution is known as basic feasible solution. 
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[f all the variables in the basic feasible solution are non-zero, then it is 
called non-degenerate solution and if some of the variables are zero, it is 
called degenerate solution. 


(iit) A new basic feasible solution may be obtained from the previous 
one by equating one of the basic variables to zero and replacing it by a new 
non-basic variables. The eliminated variable is called the leaving or outgo- 
ing variable while the new variable is known as the entering or incom- 
ing variable. 


The incoming variable must improve the value of the objective function 
which is ensured by the optimality condition. This process is repeated until 
no further improvement is possible. This process is repeated until no further 
improvement is possible. The resulting solution is called the optimal basic 
feasible solution or simply optimal solution. 


The simplex method is, therefore, based on the following two conditions: 


I. Feasibility condition. It ensures that if the starting solution is basic 
feasible, the subsequent solutions will also be basic feasible. 


II. Optimality condition. It ensures that only improved solutions will 
be obtained. 


Now, we shall elaborate the above terms in relation to the general linear 
programming problem in standard form, i.e., 


Maximize Z=c,x,+cnx,+...+¢x, (1) 
subject to Sax —s, =b,,=1,2,----+- sm (2) 

j=l 
and x,20,5,20,j7=1,2,...n (3) 
(i) Solution. x,, x,, «++. x, is a solution of the general L.P.P. if it satisfies 


the constraints (2). 


(ii) Feasible solution. x,, x,, +++. x, is a feasible solution of the general 
L.P.P. if it satisfies both the constraints (2) and the non-negativity restric- 
tions (3). The set S of all feasible solutions is called the feasible region. A 
linear program is said to be infeasible when the set S is empty. 


(iii) Basic solution is the solution of the m basic variable when each of 
the n non-basic variables is equated to zero. 


(iv) Basic feasible solution is that basic solution which also satisfies the 
non-negativity restriction (3). 
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(v) Optimal solution is that basic feasible solution which also optimizes 
the objective function (1) while satisfying the conditions (2) and (3). 


(iv) Non-degenerate basic feasible solution is that basic feasible solution 
which contains exactly m non-zero basic variables. If any of the basic vari- 
ables becomes zero, it is called a degenerate basic feasible solution. 


EXAMPLE 12.13 


Find all the basic solutions of the following system of equations identi- 
fying in each case the basic and non-basic variables: 
Qn, +x, +4x,=11, 3x, +x, + 5x, = 14. 
Investigate whether the basic solutions are degenerate basic solutions or 
not. Hence find the basic-feasible solution of the system. 
Solution: 


Since there are m + n = 3 variables and there are m = 2 constraints in 
this problem, a basic solution can be obtained by setting any one variable 
equal to zero and then solving the resulting equations. Also the total num- 
ber of basic solutions ="*"C_=°C, = 3. 


The characteristics of the various basic solutions are given below: 


No. of basic| Basic |Non-basic| Values of basic Ns ae iB ees 
solution |variables| variables variables Oe all x >0 | dass orto 
2x, +x,= 11 
1. oe oe Xs 3x, +x, = 14 Yes No 
x, =3,%x,= 5 
x, +4x,= 11 
9 2%, x x, + 5x, = 14 No Yes 
“X,=3,x,=-1 
2 x, + 4x, =11 
3 oe 2X, 3x, +5x, = 14 Yes No 
x, = 1/2,x,= 5/2 


The basic feasible solutions are: 
(i)x, =3,x,=5,x,=0 (ii) x, =12,x,=0, x3 =5/2 


which are also non-degenerate basic solutions. 
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EXAMPLE 12.14 


Find an optimal solution to the following L.P.P. be computing all basic 
solutions and then finding one that maximizes the objective function: 

2x, + 38,—2, + 40,=8,%, = 2x, + 6x,—7x,=-3 

ae ee ee CL Max. Z=2x, + 3x, + 4x, + 7x, 

Solution: 


Since there are four variables and two constraints, a basic solution can 
be obtained by setting any two variables equal to zero and then solving the 
resulting equations. Also the total number of basic solutions = *C, = 6. 


The characteristics of the various basic solutions are given below: 


No. of | Basic —__|Non-basic Values of — {Is the solution) Value Is the 
basic | variables | variables basic feasible? of Z | solution 
solution variables (Are all optimal? 
x, = OP) 
j 

1 X45 Ky Xy,t,=0 | Ww, +3x,=8 

x,-2x,=-3 

“x, =1,12=2 Yes 8 No 
2. a X,%,=0 | 2x, -x,=8 

x, +6x,=-3 

ox, =- 14/13, 

x, =— 67/13 No - - 
3 XX x, %,=0 | 2Wwl+4x,=8 

x,—7x,=-3 

ox, = 22/9, 

x, = 7/9 Yes 10.3 No 
4. Xin Xe x, %,=0 | 3x,-x,=8 

— 2x, + 6x,=-3 

ox, = 45/16, 

x, = 7/16 Yes 10.2 No 
5. Kosh x1, x3 =0] 3x, + 4x,=8 

—x,-7x,=-3 

2. x, = 139/39 

x,=- 7/13 No - - 
6. A x, %,=0 | —x,+4x,=8 

6x, -— 7x, =-3 

ox, = 44/17, 

x, = 45/17 Yes 28.9 Yes 
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Hence the optimal basic feasible solution is 
x, =0,4,50,%, = 44/17, 2, = 45/17 


and the maximum value of Z = 28.9. 


Exercises 12.3 


1. Reduce the following problem to the standard form: 


Determine x, 2 0, x, 2 0, x, 2 0 so as to 
Maximize Z = 3x, + 5x, + 8x, 


subject to the éonstainits Ox, — 5x, <6, 3x, + 2x, +2325, 3x, + 4x, <3. 


2. Express the following L.P.P. in the standard form: 
Minimize Z = 3x, + 2x, + 5x, 
subject to -5x, + 2x, < 5, 2x,+3x,+4x,2 7, 
2%, + 5x3 <3, pe anes to te 
3. Convert the following L.P.P. to standard form: 
Maximize Z = 3x, — 2x, + 4x, 


Subject to xt, +2, $13 <8, 2x, -x,+%x3 2 2, 
Ax, ~ 2, =0t, == 07%, a, 200, 


i ae 
4. Obtain all the basic solutions to the following system of linear equations: 
x, + 2x, +x,=4,2x, +x, +5x,=5. 

5. Show that the following system of linear equations has two degenerate 
feasible basic solutions and the non-degenerate basic solution is not 
feasible: 

2x, +x,—X,= 2, 3x, + 2x, +x, = 3. 
6. Find all the basic feasible solutions of the equations: 
2x, + 6x, + 2x, +x, = 3, Bx, + 4x, + 4x, + Bx, = 2. 

7. Find all the basic solutions to the following problem: 
Maximize Z = 1 3x, + ae 
subject to x, + 2x, + 3x, aa 2x, + 8x, + 5x, = 7. 


Which of the basic solitons are 
(a) non-degenerate basic feasible, (b) optimal basic feasible? 


8. Show that the feasible solution 
x, =0,x,=1,;2=6 
to the system of equations 
x, +x, +%,=2;x,-x, +x, =2 
with maaan Ze Q t+ “3x, + 4x, is not basic. 
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12.8 Working Procedure of the Simplex Method 


Assuming the existence of an initial basic feasible solution, an optimal 
solution to any L.P.P. by simplex method is found as follows: 


Step 1. (i) Check whether the objective function is to be maximized or mini- 
mized. 

If Z=clx,t+cen,+cx,+---+cx, 
is to be minimized, then convert it into a problem of maximization, by 
writing. 

Minimize Z = Maximize (— Z) 

(ii) Check whether all b’s are positive. 

If any of the b's is negative, multiply both sides of that constraint by — 1 
so as to make its right hand side positive. 

Step 2. Express the problem in the standard form. 


Convert all inequalities of constraints into equations by introducing 
slack/surplus variables in the constraints giving equations of the form. 


6, X, #02, td, Nyt ot + 8, +08, +08, + oo Sb 


Step 3. Find an initial basic feasible solution. 


ie 


If there are m equation involving n unknowns, then assign zero values 
to any (n — m) of the variables for finding a solution. Starting with a basic 
solution for which x: j = 1, 2, ---, (n —m) are each zero, find alls. If alls, are 
2 0, the basic solution is feasible and non-degenerate. If one or more of the 
s, values are zero, then the solution is degenerate. 


The above information is conveniently expressed in the following sim- 


plex table: 


C C, Cy Cq.+++0 0 Onesies 
C, Basis x, Xe Krave Sy Byars 
0 8) fe; a, igual (0) Deed 
0 Ss a5, a, en! 1 Ds sisi 
0 S, a, a, | re 0 Desc 


Body matrix Unit matrix 
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[The variables s,, s,, s, etc. are called basic variables and variables x, x,, 


x, etc. are called non-basic variables. Basis refers to the basic variables eo: 
S, +++. €, row denotes the coefficients of the variables in the objective func- 
tion, while c,—column denotes the coefficients of the basic variables only in 
the objective function. b-column denotes the values of the basic variables 
while remaining variables will always be zero. The coefficients of x’s (deci- 
sion variables) in the constraint equations constitute the body matrix while 


coefficients of slack variables constitute the unit matrix]. 
Step 4. Apply optimality test. 
Compute C=c —Z where Z = Sc, a, 
ie og ‘i ij 


[C, -row is called net evaluation row and indicates the per unit increase 
in the objective functions if the variable heading the column is brought into 
the solution. ] 


If all C, are negative, then the initial basic feasible solution is optimal. If 


even one C. is positive, then the current feasible solution is not optimal (i.e., 
can be improved) and proceed to the next step. 


Step 5. (i) Identify the incoming and outgoing variables. 


If there are more than one positive C,, then the incoming variable is the 
one that heads the column containing maximum C.. The column containing 
it is known as the key column which is shown marked with an arrow at the 
bottom. If more than one variable has the same maximum C,, any of these 
variables may be selected arbitrarily as the incoming variable. 


Now divide the elements under b-column by the corresponding ele- 
ments of key column and choose the row containing the minimum positive 
ratio 0. Then replace the corresponding basic variable (by making its value 
zero). It is termed as the outgoing variable. The corresponding row is called 
the key row which is shown marked with an arrow on its right end. The 
element at the intersection of the key row and key column is called the key 
element which is shown bracketed. If all these ratios are < 0, the incoming 
variable can be made as large as we please without violating the feasibility 
condition. Hence the problem has an unbounded solution and no further 
iteration is required. 


(ii) Iterate towards an optimal solution. 


Drop the outgoing variable and introduce and incoming variable along- 
with its associated value under cB column. Convert the key element to unity 
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by dividing the key row by the key element. Then make all other elements 
of the key column zero by subtracting proper multiples of key row from the 
other rows. 


[This is nothing but the sweep-out process used to solve the linear equa- 
tions. The operations performed are called elementary row operations. | 


Step 6. Go to step 4.and repeat the computational procedure until either 
an optimal (or an unbounded) solution is obtained. 


EXAMPLE 12.15 

Using simplex method 

Maximize Z = 5x, + 3x, 

subject to x, +x, < 2, 5x, + 2x, < 10, 

oa, On, 1S x, 20, 

Solution: 

Consists of the following steps: 

Step 1. Check whether the objective function is to be maximized and all 
b’s are positive. 

The problem consists of maximization type and all b’s are = 0, so this 
step is not necessary. 

Step 2. Express the problem in the standard form. 


By introducing the slack variables s,, s,, s,, the problem in standard 
form becomes 


Maximize. Z=5 x, + 3x, + os, + os, + 08, 


subject to ti $e 8 +08, +08, = 2 (i) 
5x, + 2x, + 0s, +8, +08, = 10 (ii) 
3x, + 8x, + os, + os, + os, = 12 (iti) 

Petes. 88,20 


Step 3. Find an initial basic feasible solution. 


There are three equations involving five unknowns and for obtaining 
a solution, we assign zero values to any two of the variables. We start with 
a basic solution for which we set x, = 0 and x, = 0. (This basic solution 
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corresponds to the origin in the graphical method.) Substituting x, =x, =0 
in (i), (ii), and (iii), we get the basic solution 
s,=2,5,=10,s, = 12. 
Since all s,, s,, s, are positive, the basic solution is also feasible and non- 
degenerate. 


.. The basic feasible solution is 


x, =x, = 0 (non-basic) and s, = 2, s, = 10, s, = 12 (basic) 


1 2 
. Initial basic feasible solution is given by the following table: 
C 5 3 0 0 0 

on Basis . x sl S. . b 0 
0 S (1) 1 1 0 0 2/1<— 
0 Sy 5 2 0 1 0 10 10/5 
0 S, 3 8 0 0 1 12 12/3 

Z,=%,0, | 0 0 0 0 0 0 

C= C= Z, 5 3 0 0 0 

T 


[For x,-column (j = 1), Z, = Zc, 4, =0(1) + 0(5) + 0(3) =0 

and for x,-column (j = 2), Z, = Zc, 4, =0(1) + 0(2) + 0(8) =0 

Similarly Z(b) = 0(2) + 0(10) + 0(12) = 0.] 

Step 4. Apply optimality test. 

As C, is positive under some columns, the initial basic feasible solution 
is not optimal (i.e., can be improved) and we proceed to the next step. 

Step 5. (i) Identify the incoming and outgoing variables. 


The previous table showed that x, is the incoming variable as its incre- 
mental contribution C, (= 5) is maximum and the column in which it ap- 
pears is the key column (shown marked by an arrow at the bottom). 


Dividing the elements under the b-column by the corresponding ele- 
ments of key-column, we find a minimum positive ratio 0 is 2 in two row. 
We, therefore, arbitrarily choose the row containing s, as the key row 
(shown marked by an arrow on its right end). The element at the intersec- 
tion of the key row and the key column i.e., (1), is the key element s, there- 
fore, the outgoing basic variable will now become non-basic. 
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Having decided that x, is to enter the solution, we have tried to find as 
to what maximum value x, could have without violating the constraints. So 


removing s,, the new basis will contain x,, s,, and s, as the basic variables. 


(ii) Iterate towards the optimal solution. 


To transform the initial set of equations with a basic feasible solution 
into an equivalent set of equations with a different basic feasible solution, 
we make the key element unity. Here the key element being unity, we 
retain the key row as it is. Then to make all other elements in key column 
zero, we subtract proper multiples to key row from the other rows. Here 
we subtract five times the elements of key row from the second row and 
three times the elements of key row from the third row. These become the 
second and third rows of the next table. We also change the corresponding 
value under c, column from 0 to 5, while replacing s, by x, under the basis. 
Thus the second basic feasible solution is given by the following table: 


C 5 3 0 0 0 
c, Basis cm ts s 8, a b 0 
5 | x, l l 1 0 0 2 
0 |s, 0 a i 0 
0 |s, 0 5 | =e | © 1 
Z,=Ec,a, | 5 5 5 0 0 | 10 
C, =0- Z, 0 -2 —5 0 0 


As C_is either zero or negative under all columns, the above table gives 
the optimal basic feasible solution. This optimal solution is x, = 2, x, =0 and 
maximum Z = 10. 


EXAMPLE 12.16 


A firm produces three products which are processed on three machines. 
The relevent data is given next: 


Time per unit (minutes) Machine capacity 
Machine : 
Product A Product B Product C (minutes/day) 
M ; 2 3 2 440 
M, 4 = 3 470 
M, 2 5 = 430 
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The profit per unit for products A, B, and C is $ 4, $ 3. and § 6, respective- 
ly. Determine the daily number of units to be manufactured for each product. 
Assume that all the units produced are consumed in the market. 


Solution: 


Let the firm decide to produce x,, x,, x, units of products A, B, C re- 
spectively. Then the L.P. model for this problem is: 


Max. Z=4 x, + 3x, + 6x, 
subject to Qn, + 3x, + 2x, < 440, Ax + 3x, < 470 
2x, + 5x, < 430, CK. X20, 


ye" 2? 
Step 1. Check whether the objective function is to be maximized and all 
b’s are non-negative. 
The problem consists of maximization type and b’s are = 0, so this step 
is not necessary. 


Step 2. Express the problem in the standard ee 


By introducing the slack variables s.,, 
form becomes: 
Max. Z = 4x, + 3x, + 6x, + Os, + Os, + Os, 
subjectto. 2x. 3x54 2x, 48,48, + 0s, = 440 
Ax, + Ox, +3, + 0s, ee +05, = 470 
2, + 5x, + 0x, +08, +08, +5, = 430 
Step 3. Find an initial basic feasible solution. 
The basic (non-degenerate) feasible solution is 
x, =x, =x, = 0 (non-basic) 
8,= 440, s, = 470, s, = 430 (basic) 


‘. Initial basic feasible solution is given by the following table: 


,» the problem in standard 


S55 


ea en or hon ho 
Ge Basis | x, % . s, ce S, b 0 
0 S 2 3 2 1 0 0 440 | 440/2 
0 8, 4 0 (3) 0 1 0 470 | 470/38 
0 S. 2 5 0 0 0 1 430 | 430/0 
=2¢, 4, 0 0 0 0 0 0 
Gece 4 | 3 | ® We || ee) co 
i 
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Step 4. Apply optimality test. 


As Cj is positive under some columns, the initial basic feasible solution 
is not optimal and we proceed to the next step. 


Step 5. (i) Identify the incoming and outgoing variables. 


The above table shows that x, is the incoming variable while s, is the 
outgoing variable and (3) is the key element. 


(ii) Iterate towards the optimal solution. 


Drop s, and introduce x, with its associated value 6 under c, column. 
Convert the key element to unity and make all other elements of key col- 
umn zero. Then the second feasible solution is given by the table below: 


C 4 3 6 0 0 0 
C, Basis a t, ‘. &, 8, S, b 0 
0 8, -2/3 (3) 0 1 -2/3 0 380/3 |380/9<— 
6 Xs 4/3 0 1 0 1/3 0 470/3 00 
0 8. 2 5 0 0 0 il 430 86 
0 6 0 2 0 
3 0) 0 0) 
il 


Step 6. As C_is positive under the second column, the solution is not op- 
timal and we proceed further. Now x, is the incoming variable and s, is the 
outgoing variable and (3) is the key element for the next iteration. 


Drop s, and introduce x, with its associated value 3 under c, column. 
Convert the key element to unity and make all other elements of the key 
column zero. Then the third basic feasible solution is given by the following 


table: 
C, 4 3 6 0 0 0 
e., Basis a ‘, X, &, 5; 5, b 0 
3 Xx, -2/9 il 0 1/3 -2/9 0 380/9 
6 Xx. 4/3 0 1 0 1/3 0 470/3 
0 S. 28/9 0 0 -5/3 10/9 0 1970/9 
Z, 22/3 3 6 1 4/3 0 3200/3 
c, | -10/3| 0 meer TE: 
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Now since each C, < 0, therefore it gives the optimal solution 
x, = 0, x, = 380/9, x, = 470/3 
and Z, = 3200/3 i.e., 1066.67 Dollars. 


EXAMPLE 12.17 
Solve the following L.P.P. the by simplex method: 
Minimize Z =x, — 3x, + 3x,, 
subject to 3x,—x, + 2x, <7, 2x, + 4x, 2-12, 
=a ok, 4 Sx, S 10, tt to 20, 
Solution: 
Consists of the following steps: 


Step 1. Check whether objective function is to be maximized and all b’s 
are non-negative. 
As the problem is that of minimizing the objective function, converting 
it to the maximization type, we have 
Max. Z’ =—x, + 3x, — 3x, 
As the right-hand side of the second constraint is negative, we write it as 
— x, — 4x, < 12 
Step 2. Express the problem in the standard form. 
By introducing the slack variables s,, s,, s,, the problem in the standard 
form becomes 
Max. Z’ = —x, + 3x, — 3x, + Os, + Os, + Os, 
subject to 3x, —x, + 2x, +s, + 0s, + 0s, =7 
— 2x, — 4x, + Ox, + Os, +s, + Os, = 12 
=e, an, + Ox, Os, 0s, tae 10 
tt 8 8 SO. 
Step 3. Find initial basic feasible solution. 
The basic (non-degenerate) feasible solution is 
x, =x, =x, = 0 (non-basic), s, = 7, 8, = 12, s, = 10 (basic) 
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.. Initial basic feasible solution is given by the table below: 


c, [eS saw Sia ao 

G, Basis ah i i. S, Sy S, b 0 
0 , 3 | -1 2 1 0 0 7 i eed 
0 8, 2 | -4 0 0 1 o | 12 | 19(-4) 
0 8, -4 (3) 8 0 0 1 10 10/3 

Z=Zca,, 0 | 0 | o | o [| o | o | o 

C=c,-Zj| -1 8 | <8 0 0 0 

T 


Step 4. Apply optimality test. 
As C, is positive under second column, the initial basic feasible solution 
is not optimal and we proceed further. 


Step 5. (i) Identify the incoming and outgoing variables. 


The above table shows that x, is the incoming variable, s, is the outgoing 
variable and (3) is the key element. 

(ii) Iterate towards the optimal solution. 

. Drop s, and introduce x, with its associated value 3 under c, column. 
Convert the key element to unity and make all other elements of the key 


column zero. Then the second basic feasible solution is given by the follow- 
ing table: 


@ -l 3 -3 0 0 0 
a x x, i, 2 Bis 8, b 0 
0 (5/3) 0 14/3 1 0 1/3 31/3 | 81/5 
0 $4 23/3 0 32/3 0 1 4/3 76/3 | -38/11 
3 Xx, -4/3 1 8/3 0 0 1/3 10/3 -5/2 
Z, -4 3 8 0 0 1 10 
c 0 ait || © 0 ai 


Step 6. As C. is positive under first column, the solution is not optimal 
and we proceed further. x, is the incoming variable, s, is the outgoing vari- 
able and (5/3) is the key element. 
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‘. Drop s, and introduce x, with its associated value — 1 under c, column. 
Convert the key element to unity and make all other elements of the key col- 
umn zero. Then the third basic feasible solution is given by the table below: 


C -l 3 -3 0 0 0 
é, Basis x at ‘ 7 3, S, b 
-l x, 1 0 14/5 3/5 0 1/5 31/5 
Si 0 0 156/5 22/5 1 14/5 354/5 
X, 0 1 32/5 4/5 0 3/5 58/5 
Z, -l 3 82/5 9/5 0 8/5 1483/5 
C, 0 0 -97/5 -9/5 0 -8/5 


Now since each C, < 0, therefore it gives the optimal solution 
x, = 31/5, x, = 58/5, x, = 0 (non-basic) and Z’, = 143/5. 
Hence Z| =— 143/5. 


mn 


EXAMPLE 12.18 
Maximize Z = 107x, + x, + 2x, 
subject to the constraints: 14x,+x,-6x,+3x,=7, 16x, + st — 6x, <5 
3th, = 2,5 0, tet p et, aU 
Solution: 
Consists of the following steps: 


Step 1. Check whether objective function is to be maximized and all b’s 
are non-negative. 


This step is not necessary. 
Step 2. Express the problem in the standard form. 


Here x, is a slack variable. By introducing other slack variables s, and s, 
the problem in standard form becomes 


Max. Z = 107x, +2, + 26+ Ox, + Os, +08, 


subject to Mat Ly, —2x,+x,+ 0s, + 0s, = 
3 


col 


16x, + 7 = 6x, + Ox, +8, + Os, =5 


t= eat On Os, £8, = 0, 2h ha he 88, 2 0. 
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Step 3. Find initial basic feasible solution. 
The basic feasible solution is 

x, =X, =x, =0 (non-basic) 
x,= 7/3, 8,=5, s, =0 (basic) 


‘. Initial basic feasible solution is given in the table below: 


C, 107 1 2 0 0 0 
G Basis it ts t. y ‘ is b 0 
0 me, 14/3 1/3 -2 1 0 0 7/3 z - 
3/ 3 
S, 16 1/2 -6 0 1 0 5) 5/16 
0 s, (3) | -1 ai 0 0 1 0/3 
Z,=%e,0,| 0 0 0 0 0 0 0 
C, = c-Z, 107 1 2 0 0 0 
T 


Step 4. Apply optimality test. 

As C, is positive under some columns, the initial basic feasible solution 
is not optimal and we proceed further. 

Step 5. (i) Identify the incoming and outgoing variables 

The above table shows that x, is the incoming variable, s, is the outgoing 
variable, and (3) is the key element. 

(ii) Iterate towards the optimal solution. 

Drop s, and introduce x, with its associated value 107 under c, column. 


Convert, key element to unity and make all other elements of the key column 
zeros. Then the second basic feasible solution is given by the following table: 


0 0 0 

on 8, ss b 7 
1 0 -14/9 7/3 | -21/4 
0 1 -16/3 5 | -15/2 
0 0 1/3 0 0 
0 0) 107/3 

0 0 |-107/3 
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As C_ is positive under some columns, the solution is not optimal. Here 
113/3 is the largest positive value of C., and x, is the incoming variable. But 
all the values of 6 being < 0, x, will not enter the basis. This indicates that 
the solution to the problem is unbounded. 


[Remember that (i) the incoming variable is the non-basic variable 
corresponding to the largest positive value of C, and (ii) the outgoing vari- 
able is the basic-variable corresponding to the least positive ratio 0, ob- 
tained by dividing the b-column elements by the corresponding key-column 
elements. | 


Exercises 12.4 


Using simplex method, solve the following L.P.P. (1 — 9): 
1. Maximize Z =x, + 3x, 
subject tox, + 2x, < 10,0<x,<5,0<x,<4. 
2. Maximize Z = 4x, + 10x, 
subject to 2x, +x, < 50, 2x, + 5x, < 100, 2x, + 3x, < 90, x,, x, 2 0. 
3. Maximize Z = 4x, + 5x,, 
subject to x, — 2x, < 2, 2x, +x, <6, x, + 2x, <5,-x, +x, <2,x,,x,20. 


4. Maximize Z = 10x, PA 2%, 

subject tox, +a, = 20,5 10, 4, +2, +4, £ 20,4002 0, 
5. Maximize Z =x, +x, + 3x,, 

Subject 10. On, 2 A Dee Oe So eae, a, 
6. Maximize Z =x, —x, + 3x, 


subject tox, +x, +2, < 10, 2x, —%, <2, Oy = 2x Ox, <0 x4 x SO. 


7. Minimize Z = 3x, + 5x, + 4x, 
subject to 2x, + 3x, < 8, 2x, + 5x, < 10, 
on, 2a, +4e, 5 19,0500, 20. 
8. Minimize Z =x, — 3x, + 2x,, 
subject to 3x, —x, + 2x, <7, — 2x, + 4x, < 12, 
Sag + on Be, SI), 5K XU: 
9. Maximize Z = 4x, + 3x, + 4x, + 6x, 
subject to x, + 2x, + 2x, + 4x, < 80, 2x, + 2x, +x, < 60, 


Oh Ok, ee OO eh, 
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10. 


11. 


12. 


13. 


A firm produces products A and B and sells them at a profit of $ 2 and 

$ 3 each respectively. Each product is processed on machines G and H. 
Product A requires 1 minute on G and 2 minutes on H whereas product 
B requires 1 minute on each of the machines. Machine G is not avail- 
able for more than 6 hours 40 min/day whereas the time constraint for 
machine H is 10 hours. Solve this problem via the simplex method for 
maximizing the profit. 


A company makes two types of products. Each product of the first type 
requires twice as much labor time as the second type. If all products are 
of the second type only, the company can produce a total of 500 units a 
day. The market limits daily sales of the first and the second type to 150 
and 250 units, respectively. Assuming that the profits per unit are $ 8 for 
type I and $ 5 for type I, determine the number of units of each type to 
be produced to maximize profit. 


The owner of a dairy is trying to determine the correct blend of two 
types of feed. Both contain various percentages of four essential ingredi- 
ents. With the following data determine the least cost blend? 


Ingredient depen sere Min. requirement in kg. 
i Feed 1 Feed 2 
1 40 20 + 
2 10 30 2 
3 20 40 3 
4 30 10 6 
Cost ($/keg.) 5 3 


A manufacturing firm has discontinued production of a certain unprofit- 
able product line. This created considerable excess production capacity. 
Management is considering to devote their excess capacity to one or 
more of three products 1, 2, and 3. The available capacity on machines 
and the number of machine hours required for each unit of the respec- 
tive product, is given below: 


Machine Available Time Productivity (hrs/unit) 
Type (hrs/week) Product I Product II | Product II 
Milling Machine 250 8 2 3 
Lathe 150 4 3 0 
Grinder 50 2 = 1 
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The unit profit would be $ 20, $ 6 and $ 8, respectively for products 1, 2, 
and 3. Find how much of each product the firm should produce in order 
to maximize profit. 


14. The following table gives the various vitamin contents of three types of 
food and daily requirements of vitamins along with cost per unit. Find 
the combination of food for minimum cost. 


Vitamin (mg) Food Food Food Mimimum daily 
F G requirement (mg) 
A 1 1 10 1 
C 100 10 10 50 
D 10 100 10 10 
Cost/unit ($) 10 15 5 


15. A farmer has 1,000 acres of land on which he can grow corn, wheat, 
or soyabeans. Each acre of corn costs $ 100 for preparation, requires 
s man-days of work and yie Lds a profit of $ 30. An acre of wheat costs 
$ 120 to prepare, requires ten man-days of work and yields a profit of 
$ 40. An acre of soyabeans costs $ 70 to prepare, requires eight man- 
days of work and yields a profit of $ 20. If the farmer has $ 1,00,000 for 
preparation and can count on 8,000 man-days of work, how many acres 
should be allocated to each crop to maximize profits ? 


12.9 Artificial Variable Techniques 


So far we have seen that the introduction of slack/surplus variables 
provided the initial basic feasible solution. But there are many problems 
wherein at least one of the constraints is of (2) or (=) type and slack vari- 
ables fail to give such a solution. There are two similar methods for solving 
such problems which we explain below 


M-method or Method of penalties. This method is due to A. Charnes 
and consists of the following steps: 


Step 1. Express the problem in standard form. 


Step 2. Add non-negative variables to the left hand side of all those 
constraints which are of (2) or (=) type. Such new variables are called ar- 
tificial variables and the purpose of introducing these is just to obtain an 
initial basic feasible solution. But their addition causes violation of the cor- 
responding constraints. As such, we would like to get rid of these variables 
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and would not allow them to appear in the final solution. For this purpose, 
we assign a very large penality (— M) to these artificial variables in the objec- 
tive function. 


Step 3. Solve the modified L.P.P. by simplex method. 


At any iteration of the simplex method, one of the following three cases 
may arise: 


(i) There remains no artificial variable in the basis and the optimality 
condition is satisfied. Then the solution is an optimal basic feasible solution 
to the problem. 


(ii) There is atleast one artificial variable in the basis at zero level (with 
zero value in b-column) and the optimality condition is satisfied. Then the 
solution is a degenerate optimal basic feasible solution 


(iii) There is at least one artificial variable in the basis at the non-ze- 
ro level (with positive value in b-column) and the optimality condition is 
satisfied. Then the problem has no feasible solution. The final solution is 
not optimal, since the objective function contains an unknown quantity M. 
Such a solution satisfies the constraints but does not optimize the objective 
function and is therefore, called pseudo optimal solution. 


Step 4. Continue the simplex method until either an optimal basic feasible 
solution is obtained or an unbounded solution is indicated. 


NOTE. Obs. The artificial variables are only a computational device for 
getting a starting solution. Once an artificial variable leaves the 
basis, it has served its purpose and we forget about it, i.e., the 
column for this variable is omitted from the next simplex table. 


EXAMPLE 12.19 
Use Charne’s penalty method to Minimize Z = 2x, + x, 


subject to 3x, +x, = 3, 4x, + 3x, > 6, 
et, Se, 620. 
Solution: 


Consists of the following steps: 
Step 1. Express the problem in standard form. 


The second and third inequalities are converted into equations by in- 
troducing the surplus and slack variables s_, s,, respectively. 
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Also the first and second constraints being of (=) and (2) type, we intro- 
duce two artificial variables A,, A,. 


Converting the minimization problem to the maximization form for the 
L.P.P. can be rewritten as 


Max. Z’ = — 2x, —x, + Os, + 0s, - MA1 - MA2 
subject to 3x, +x, +0s,+0s,+A,+0A,=3 
4x +3x,—s,+0s,+0A,+A,=6 
x, 42x, +08, +5, +04, +0A, =3 
1 ae ee Ee ee «eres ee 
Step 2. Obtain an initial basic feasible solution. 


Surplus variable s, is not a basic variable since its value is — 6. As nega- 
tive quantities are not feasible, s, must be prevented from appearing in the 
initial solution. This is done by taking s, = 0. By setting the other non-basic 
variables x,, x, each = 0, we obtain the initial basic feasible solution as 

x, =x,=0,5,=0 
A, =3,A,=6,5,=3 
Thus the initial simplex table is 


C -2 -l 0 0 —M —M 
Basis oa < oH 5, A, A, b 6 
—M A, (3) 1 0 0 1 0 3 3/3 
—M A, 4 3 -l 0 0 6 6/4 
5 1 2 0 1 0 0 3 3/1 
Z,=Xc,a -~7M -4M M 0 -M | -M | -9M 
C=6-% 7M-2 | 4M-1 |} -M 0 0 0 
i 


Since C, is positive under x, and x, columns, this is not an optimal solution. 
Step 3. Iterate towards optimal solution. 


Introduce x, and drop A, from basis. 
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.. The new simplex table is 


C —Y —Il 0 0 —M 
. Basis tt i: s Ss; A, b 6 
~2 x, 1 V3 0 0 0 1 3 
—M | A, 0 (5/3) i 0 1 9 6/5 
0 s, 0 5/3 0 1 0 2 6/5 
2 5M 
Z 2 = =— M 0 —M |-2-2M 
J 3. C8 
1 5M 
G 0 ——+—_| -M 0 0 
J 3. C8 
T 


Since C, is positive under x, column, this is not an optimal solution. 
.. Introduce x, and drop A,,. 


Then the revised simplex table is 


C —2 —l 0 0) 
om Basis . a s 5, b 
—2 x, 1 0 1/5 0 3/5 
-l Xi 0) 1 —3/5 0) 6/5 
0 s, 0 0 1 1 0 
Z, —2 -l 1/5 0 —12/5 
C, 0 0) -1/5 0 


Since none of C, is positive, this is an optimal solution. Thus, an optimal 
basic feasible solution to the problem is 


x, = 3/5, x, = 6/5, Max. Z’ =— 12/5. 
Hence the optimal value of the objective function is 
Min. Z =— Max. Z’ = — (— 12/5) = 12/5. 


EXAMPLE 12.20 
Maximize Z = 3x, + 2x, 


subject to the constraints: 26 eee 2, Or ay 2 1, 
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Solution: 
Consists of the following steps: 
Step 1. Express the problem in standard form. 


The inequalities are converted into equations by introducing the slack 
and surplus variables s,, s,, respectively. Also the second constraint being 
of (2) type, we introduce the artificial variable A. Thus the L.P.P. can be 
rewritten as 


Max. Z = 3x, + 2x, + Os, + Os, — MA 
subject to 2x, +x,+s,+0s,+0A=2, 
3x, +4x,+0s,-s,+A= 12, 


OMe Si gSeg Ae ND, 


“g7 Py? Pg? 
Step 2. Find an initial basic feasible solution. 


Surplus variable s, is not a basic variable since its value is —12. Since a 
negative quantity is not feasible, s, must be prevented from appearing in the 
initial solution. This is done by letting s, = 0. By taking the other non-basic 
variables x, and x, each = 0, we obtain the initial basic feasible solution as 


x, =x, =s,=0,5,=2,A=12 


1 2 


‘. The initial simplex table is 


C 3 2 0 0 —M 
o, Basis it, a ce S5 b 7 
0 , 5 (1) I 0 0 2 ya 
—M A 3 4 0 -l 12 3 
8, 0 53 | 0 | 1 0 {2 65 
Z,=XC,a -3M —-4M 0 M —M —12M 
C, =¢= Z, 343M | 2+4M 0 —M 0 
T 


Since C. is positive under some columns, this is not an optimal solution. 
Step 3. Iterate towards optimal solution. 


Introduce x, and drop s,. 
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.. The new simplex table is 


C 3 2 0) 0 —M 
C. Basis iy - on Ss, A b 
2 x, 2 1 1 0 0 
0 
Z, 4+5M 2 2+ 4M M —M 4-4M 
C —(1+5M) 0 (2+ 4M) —M 0 


Here each Cis negative and an artificial variable appears in the basis at the 
non-zero level. Thus there exists a pseudo optimal solution to the problem. 


Two-phase method. This is another method to deal with the artificial vari- 
ables wherein the L.P.P. is solved in two phases. 


Phase I. Step 1. Express the given problem in the standard form by intro- 
ducing slack, surplus, and artificial variables. 
Step 2. Formulate an artificial objective function 
Z* ==Ay Ay a ie =A, 


by assigning (— 1) cost to each of the artificial variables A, and zero cost 
to all other variables. 


Step 3. Maximize Z* subject to the constraints of the original problem 
using the simplex method. Then three cases arise: 


(a) Max. Z* < 0 and at least one artificial variable appears in the opti- 
mal basis at a positive level. 

In this case, the original problem does not possess any feasible solution 
and the procedure comes to an end. 

(b) Max. Z* = 0 and no artificial variable appears in the optimal basis. 


In this case, a basic feasible solution is obtained and we proceed to 
phase II for finding the optimal basic feasible solution to the original prob- 
lem. 


(c) Max. Z* = 0 and at least one artificial variable appears in the optimal 
basis at zero level. 


Here a feasible solution to the auxiliary L.P.P. is also a feasible solution 
to the original problem with all artificial variables set = 0. 
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To obtain a basic feasible solution, we prolong phase I for pushing all 
the artificial variables out of the basis (without proceeding on to phase II). 


Phase II. The basic feasible solution found at the end of phase I is used 
as the starting solution for the original problem in this phase, i.e., the final 
simplex table of phase I is taken as the initial simplex table of phase II 
and the artificial objective function is replaced by the original objective 
function. Then we find the optimal solution. 


EXAMPLE 12.21 
Use a two-phase method to 
Minimize Z = 7.5x, — 3x, 
subject to the constraints 3x,—x,—x,23,x,-x, +x, 22, %,,%,, Xx, 20. 
Solution: 


Phase I. Step 1. Express the problem in standard form. 


Introducing surplus variables s,, s, and artificial variables A,, A,. The 
phase I problem in standard form Kecomes 


Max. Z* = Ox, + Ox, + Ox, + Os, +0s,-—A,—A, 
subject to 3x, -—x,-x,—s,+0s,+A,+0A,=3 
x, =a, +2, 4+0s,—s,+0A,+A,=2 
BN i Sig Be Ay Ae 0 


Step 2. Find an initial basic feasible solution. 


Setting x, =x, =x, =s, =s, =0, 
we have A, =3, A, =2and Z* =-5 


*. Initial simplex table is 
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As C, is positive under x, column, this solution is not optimal. 
Step 3. Iterate towards an optimal solution. 


Making key element (3) unity and replacing A, by x,, we have the new 
simplex table: 


0 x, 1 

-l Li, 0 -2/3 | 4/3 1/3 -l -1/3 1 1 3/4e 
Z* 0 2/3 | -4/3 } -1/3 1 1/3 -l -l 
C; 0 -2/3 | 4/3 1/3 -l -1/3 0 


Since C, is positive under x, ands, columns, this solution is not optimal. 


Making key element (4/3) unity and replacing A, by x,, we obtain the 
revised simplex table: 


C 0 0 0 0) 0) —l -l 
é. Basis - t, ‘ cn A A, A, b 
0 x, 1 -1/2 0 -1/4 -1/4 1/4 1/4 5/4 
0 x 0 -1/2 1 1/4 —3/4 -1/4 3/4 3/4 
rg 0 0 0 0 0 0 0 0 
C 0 0 | 0 0 0 |r | 


Since all C, < 0, this table gives the optimal solution. Also Z* = 0 and 
no artificial variable appears in the basis. Thus an optimal basic feasible 
solution to the auxiliary problem and therefore to the original problem, has 
been attained. 


Phase II. Considering the actual costs associated with the original vari- 
ables, the objective function is 


Max. Z’ = — 15/2x, + 3x, + Ox, + Os, + Os, — OA, - OA, 
subject to 3x, —x, —X,-8,+ Os, + A, + OA, = 38, 
© =a, bag ts, =, 0A, PAL = 2, 

Lees fea ee Pe Pee 2 res Oe 


The optimal initial feasible solution thus obtained, will be an optimal 
basic feasible solution to the original L. P.P. 
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Using final table of phase I, the initial simplex table of phase II is as 
follows: 


Since all C, < 0, this solution is optimal. 


Hence an optimal basic feasible solution to the given problem is 
x, =5/4, x, =0, x, = 3/4 and min. Z = 75/8. 


12.10 Exceptional Cases 


Tie for the incoming variable. When more than one variable has the 
same largest positive value in C. row (in maximization problem), a tie for the 
choice of incoming variable occurs. As there is no method to break this tie, 
we choose any one of the prospective incoming variables arbitrarily. Such 
an arbitrary choice does not in any way affect the optimal solution. 


Tie for the outgoing variable. When more than one variable has the 
same least positive ratio under the 6-column, a tie for the choice of outgo- 
ing variable occurs. If the equal values of said ratio are > 1, choose any 
one of the prospective leaving variables arbitrarily. Such an arbitrary choice 
does not affect the optimal solution. 

If the equal values of ratios are zero, the simplex method fails and we 
make use of the following degeneracy technique. 


Degeneracy. We know that a basic feasible solution is said to be degen- 
erate if any of the basic variables vanishes. This phenomenon of getting a 
degenerate basic feasible solution is called degeneracy which may arise 


(i) at the initial stage, when at least one basic variable is zero in the 
initial basic feasible solution or 


(ii) at any subsequent stage, when the least positive ratios under 0 the- 
column are equal for two or more rows. 
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In this case, an arbitrary choice of one of these basic variables may re- 
sult in one or more basic variables becoming zero in the next iteration. At 
times, the same sequence of simplex iterations is repeated endlessly with- 
out improving the solution. These are termed as cycling type of problems. 
Cycling occurs very rarely. Intact, cycling has seldom occurred in practical 
problems. 


To avoid cycling, we apply the following perturbation procedure: 


(i) Divide each element in the tied rows by the positive coefficients of 
the key column in that row. 


(ii) Compare the resulting ratios (from left to right) first of unit matrix 
and then of the body matrix, column by column. 


(iit) The outgoing variable lies in that row which first contains the small- 
est algebraic ratio. 


EXAMPLE 12.22 
Maximize Z = 5x, + 3x, 
subjecttox,+%, <2, br 2x, < 10) 30, br, = 1230, x 0) 
Solution: 
Consists of the following steps: 
Step 1. Express the problem in the standard form. 


Introducing the slack variables s,, s,, s,, the problem in the standard 
form is 


Max. Z = 5x, + 3x, + Os, + Os, + Os, 

x, +x, +s, + 0s, 40s, = 2, 5x, + 2x, +08, +5, +0s,= 10 
ox + Om, Os, 40s, 8. = ID ats 8.8, 2 0: 

Step 2. Find the initial basic feasible solution. 

The initial basic feasible solution is 

x, =x, = 0 (non-basic) 

8, = 2,8, = 10, s,= 12 (basic) and Z =0. 


. Initial simplex table is 
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C 3 0 0 0 
Gs Basis ‘ ‘. si - &, b 0 
0) 8 1 1 0 0) 2 2/1 
0 $5 (5) 2 0) 1 0 10 10/5 
0 S, 8 0 0) i 12 12/3 
Z,= Dey, 0 0 0 0 0 
C, =O Z, 3 0 0) 0 


As C, is positive under some columns, this solution is not optimal. 


Step 3. Iterate towards optimal solution. 


x, is the incoming variable. But the first two rows have the same ratio 
under 6-column. Therefore we apply perturbation method. 


First column of the unit matrix has 1 and 0 in the tied rows. Dividing 
these by the corresponding elements of the key column, we get 1/1 and 0/5. 
s,-row gives the smaller ratio and therefore s, is the outgoing variable and 


(5) is the key element. 


Thus the new simplex table is 


C, 5 S 0) 0) 0) 
a Basis a . om co s, b 6 
0 S 0 (3/5) i -1/5 0 0) Oe 
5 Sy 1 2/5 0 1/5 0) 2 5 
0) 85 0) 34/5 0 -3/5 1 6 15/17 
Z, 5 2 0) 1 0) 10 
C, 0) 1 0 -l 0) 

T 


As C, is positive under x, column, this solution is not optimal. 


Making key element (3/5) unity and replacing s, by x,, we obtain the 
revised simplex table: 


C ® 3 0 0 0 
ec, Basis om % ss ‘, 8 b 
3 x, 0) 1 5/3 -1/3 0) 0 
5 x, 1 0) -2/3 1/3 0 2 
0 S3 0 0 -34/3 5/3 1 6 
Zz, 5 3 5/3 2/3 0) 10 
Cc, 0) 0 -5/3 -2/3 0 
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As C. <0 under all columns, this table gives the optimal solution. Hence 
an optimal basic feasible solution is x, =2,x,=0 and Z, = 10. 


Exercises 12.5 


Solve the following L.P. problems using the M-method: 
1. Maximize Z = 3x, + 2x, + 3x, 
subject to: 2x, +2, +x, <2, Ox, +40, 424,28, 2, %,,0, 20. 
2. Maximize Z = 2x, + x, + 3x, 
subject to: x, +x, + 2x, <5, 2x, + 3x, + 4x, = 12, x,, x,, x, 2 0. 
3. Maximize Z = 8x,, 
subject to: x, — x, > 0, 2x, + 3x, <- 6, x,, x, unrestricted. 


4. Minimize Z = 4x, + 3x, +x, 

subject tora, + 2x, 4a, > 12, 3x + Bx a > 8 x, 5,8, = 0: 
5. Maximize Z=x, + 2x, + 3x,-x, 

subject to: x, + 2x, + 3x, = 15, 2x, +x, + 5x, = 20, 

Gent te, = 10,2 he tS. 

Use two phase method to solve the following L.P. problems: 
6. Minimize Z = x Fa, 

subject tor 2x ex, 4 1 7, ee, SO, 
7. Maximize Z = 5x, + 3x, 

subject to; 2x, +4,< 1.4%, +4%,2 6,.4..0,20: 
8. Maximize Z = 5x, ty a 

subject to: 2x, + 2x, —x, = 2, 

ot, 4a, S30 FeSO, o ho, 2 OU. 
9. Maximize Z = 5x, — 4x, + 3x, 

subject to: 2x, +x, — 6x, = 20, 6x, + 5x, + 10x, < 76, 

ono Or, a o0le a2, 
Solve the following degenerate L.P. problems: 

10. Maximize Z = 9x, + 3x, 


subject to: 4x, +x, <8, 2x, +x, <4,x,,x, 20. 
11. Maximize Z = 2x, + 3x, + 10x, 
subject to: x, + 2x,=0,x,+x,=1,x,,x,,x, 20. 
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12. Maximize Z = 0.5x, + 6x, + 5x, 
subject to: 4x, Gx, + On, = 249, by ox, < 12. Oe ae = 12, 
Xi. % 2 0, 


12.11 Duality Concept 


One of the most interesting concepts in linear programming is the 
duality theory. Every linear programming problem has associated with it, 
another linear programming problem involving the same data and closely 
related optimal solutions. Such two problems are said to be duals of each 
other. While one of these is called the primal, the other the dual. 


The importance of the duality concept is due to two main reasons. First, 
if the primal contains a large number of constraints and a smaller of vari- 
ables, the labor of computation can be considerably reduced by converting 
it into the dual problem and then solving it. Secondly, the interpretation of 
the dual variables from the cost or economic point of view proves extremely 
useful in making future decisions in the activities being programmed. 


Formulation of dual problem. Consider the following L.P.P: 


Maximize Z=clx,+c2x,+---+cx 


nn? 


subject to the constraints a,x, +4,x,+-:-+a,x Sb, 


OR a a a ie eS b2, 


To construct the dual problem, we adopt the following guide-lines: 


(i) The maximization problem in the primal becomes the minimization 
problem in the dual and vice versa. 


(ii) (S) type of constraints in the primal become (2) type of constraints 
in the dual and vice versa. 


(iti) The coefficients c,,c,, ---. ,c, in the objective function of the primal 
become b,, b,, ---, b, in the objective function of the dual. 


(iv) The constants b,, b,, ---, b, in the constraints of the primal become 


C,,€,, +++, €, in the constraints of the dual. 
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(v) If the primal has n variables and m constraints, the dual will have 
m variables and n constraints, i.e., the transpose of the body matrix of the 
primal problem gives the body matrix of the dual. 

(vi) The variables in both the primal and dual are non-negative. 

Then the dual problem will be 

Minimize W=b,y,+b,y,+---.+b,y,, 


subject to the constraints a, y,+4,,y,+--+.+4@,y, 2, 


m 


AY Fy Yat rrr TAY 2 Cy 


m 


A191 7 AY 5 eee as Dd mn 2 Cy 


Yp> Yo et YO. 


EXAMPLE 12.23 
Write the dual of the following L.P.P: 
Minimize Z = 3x, — 2x, + 4x, 
subject to 3x, + 5x, + 4x, 2 7, 6x, +x, + 8x, 2 4, 
Tx, — 2x, —x, < 10, x, — 2x, + 5x, 23, 
Ag 1K Hak, 2 AN, By KU, 
Solution: 


Since the problem is of minimization, all constraints should be of = 
type. We multiply the third constraint throughout by — 1 so that 


— Tx, + 2x, +x,2—-10 


Let y,, Ys Y3>Y, and y, be the dual variables associated with the above 
five constraints. Then the dual problem is given by 


Maximize W = 7 _ + 4y, — 10y, + 3y, + 2y, 
subject to 3y, + 6y, — Ty, + y, + 4y, <3, 5y, +y, + 2y,- 2y,+ Ty, <-2 
dy, + 3Yy, + Ys + SY, 2Y5 4 Yi Yo Yor Yn Ys 29. 
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Formulation of dual problem when the primal has equality constraints. 
Consider the problem. 


Maximize Z=C,x,+0.%, 


subject to G0 Oe ahd to Oe Shee oe 0, 


The equality constraint can es written as 
ia +0,2,<b- anda. ola x >), 


or Gt ae. 


7 <b, and-a,,x,-4,x, <—b, 


2 


Then the above problem can be restated as 
Maximize Z =c,x, +c,x, 


subject to a,x, + a,x, $b,,-4,,x, -4,,x, <-b,, 


eee 1 <2,20, 


Now we form the dual using y,’, y,”, y, as the dual variables. 

Then the dual problem is 

Minimize W =b (y,’-y,”) + by,, 

subject to ay (yy a yy”) + BY, 2 C), a (yy —Y, ”) a AY 5 2 2,1 he > yy” > 
Y,2 0. 

The term (y,’ — y,”) appears in both the objective function and all the 
constraints of the dual. This will always happen whenever there is an equal- 
ity constraint in the primal. Then the new variable y,’ — y,” (= y,) becomes 
unrestricted in sign being the difference of two non-negative variables and 
the above dual problem takes the form. 

Minimize W =b,y, + b.y,, 

subject to CD OU. Cl, Gea, Pe, 

y, unrestricted in sign, y, = 0. 


In general, if the primal eae is 


Maximize Z=c,x,+c,4,+---+ce% 


non? 


subject to a,x, +4,x, +++: +a,x=b, 


C3 $6,506 .c ak = ob, 


aril 29°°2 2Qn~n 


Ce See ee a ae tS) 
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then the dual problem is 
Minimize W=b,y,+ by,+---+b,y,, 
subject tO. 0,4 04/4 0 POY, OC; 

AY, + AyYo to GY, 2 Co» 

GY, + Ey Yot-- FG, Y,, 26, 

Y> Yo +++, Y,, all unrestricted in sign. 


Thus the dual variables corresponding to equality constraints are un- 
restricted in sign. Conversely when the primal variables are unrestricted in 
sign, the corresponding dual constraints are equalities. 


EXAMPLE 12.24 
Construct the dual of the L.P.P: 
Maximize Z = 4x, + 9x, + 2x5, 
subject to 2x, + 3x, + 2x, <7, 3x, — 2x, + 4x, =5, xX, XX, 2 0. 
Solution: 


Let y, and y, be the dual variables associated with the first and second 
constraints. Then the dual problem is 


Minimize W = 7y, + 5y,, 


subject to 2y, + 3y, < 4, 3y, — 2y, < 9, 2y, + 4y, < 2, y, 2 0, y, is unre- 
stricted in sign. 


Exercises 12.6 


Write the duals of the following problems: 


1. Maximize Z = 10x, + 13x, + 19x, 


subject to Gt, hot, toe. = 26. an. + oe + Ons 7,288, 0. 
2. Minimize Z = 2x, + 4x, + 3x, 
subject to 3x, + 4x, +x, 2 11, - 2x, - 3x, + 2x, 5-7, 


x, — 2x, — 3x, <1, 3x, + 2x, + Wx, = 5, X,, XX 2 0. 
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3. Maximize Z = 3x, +x, + 4x,+x,+ 9x,, 
Ax — 5x, ~ Or, +2, 25 <6, 2h, + 3x, + 4e, = 5x, 20 SY, 
x, $x, bx, — 7x, iis 2 10< x x Po 


? Vv 2? x 3 > 4? 
4. Maximize Z = 3x, + 16x, + 7x, 


subject to HRs On, 2 38, — de, 2x, < 1, 


Ox, +X, — Xx. =4,x,2,%,20. 


5. Maximize Z = 3x, +x, + 2x, 
subject to x, +x, +x, 2 6, 3x, — 2x, + 3x, = 3, 
= 46, 3x, = On, =4, x2, x, 20. 
6. Minimize Z = 2x, + 3x, + 4x, 
subject to =. 2x, + 8x, + 5x, = 2, 3x, +x, + Tx, = 3, 


if 4x, ; 6x, < Bites x, > 0 winds x, is unrestricted. 


7. Obtain the dual problem of the following L.P.P: 
Maximize f(x) = 2x, + 5x, + 6x, 
subject to the constraints: 
dx, + 6x, -—x, 53, — 2x, +x, + 4x, $4, 
x ~ 5a, +34, <1, ~ 31, Lay + Tk, <6,x,,x,,x,20. 


aya ga a 


Also verify that the dual of the dual problem is the primal problem. 


12.12 Duality Principle 


If the primal and the dual problems have feasible solutions then both 
have optimal solutions and the optimal value of the primal objective func- 
tion is equal to the optimal value of the dual objective function, i-e., 


Max. Z = Min. W 
This is the fundamental theorem of duality. It suggests that an optimal 
solution to the primal can directly be obtained from that of the dual prob- 
lem and vice-versa. 
Working rules for obtaining an optimal solution to the primal 


(dual) problem from that of the dual (primal): 


Suppose we have already found an optimal solution to the dual (primal) 
problem by the simplex method. 


Rule I. If the primal variable corresponds to a slack starting variable in 
the dual problem, then its optimal value is directly given by the coefficient 
of the slack variable with a changed sign, in the C, row of the optimal dual 
simplex table and vice-versa. 
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Rule II. If the primal variable corresponds to an artificial starting vari- 
able in the dual problem, then its optimal value is directly given by the 
coefficient of the artificial variable, with a changed sign, in the C, row of the 
optimal dual simplex table, after deleting the constant M and vice- versa. 


On the other hand, if the primal has an unbounded solution, then the 
dual problem will not have a feasible solution and vice-versa. 


Now we shall work out two examples to demonstrate the primal dual 
relationships. 


EXAMPLE 12.25 


Construct the dual of the following problem and solve the primal and 
the dual: 


Maximize Z = 2x, +X, 
subject to =8, te Ae ee RA Re 
Solution: 


Using the primal problem. Since only two variables are involved, it is 
convenient to solve the problem graphically. 


In the x,x,-plane, the five constraints show that the point (x,, x,) lies 
within the shaded region OABCD of Figure 12.12. 


XA 


O A(3,0)X, 


FIGURE 12.12 
Values of the objective function Z = 2x, +x, at these corners are Z(0) = 
0, Z(A) =6, Z(B) = 7, Z(C) =6, and Z(D) = 1 


Hence the optimal solution is x, = 3, x, = 1 and max. Z= 7. 


Solution: 
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Using the dual problem. The dual problem of the given primal is: 
Minimize W = 2y, + 4y, + 3y, 


subject to 


Step 1. Express the problem in the standard form. 


=Y, tye t ys 2, 2y, ty, 21,4, 4,20. 


Introducing the slack and the artificial variables, the dual problem in 
the standard form is 


Max. W’ = -— 2y, — 4y, — 3y, + 0s, + Os, - MA, - MA, 


subject to 


=y, +y, + Y,—8, + 0s, +A, + 0A, =2, 


2y,+y,+ O0y,+0s,—s,+0A,+A,= a 


Step 2. Find an initial basic feasible solution. 


Setting the non-basic variables y,,, y,, y,, 8,, 8, each equal to zero, we get 
the initial basic feasible solution as 
(non-basic), A, = 2, A, = 1. (basic) 


Y= Y,= 43-5, =8 


= 0 


2 


.. Initial simplex table is 


C, —y —-4 -3 0) 0) —M —M 
Cz Basis yy Ys Y, sy Sy A, A, b 0 
—M A, —l 1 1 -l 0 1 0 2 2/1 
—M A, 2 (1) 0 0 =], 0 I 1 W1e 
Zz —-—M | -2M | -M M M —M —M | -3M 
C, M-2 | 2M-4 |] M-3 M —M 0 0 
T 
As C, is positive under some columns, the initial solution is not optimal. 
Step 3. Iterate toward an optimal solution. 
(i) Introduce y, and drop A,. Then the new simplex table is 
C, —2 4 -3 0) 0) —M 
c, | Basis | y, i, g, S A, b 6 
—M | A 3 “a =i I =i 1 fie 


oc] kh} Rl os 


o| £} of H|>]e 
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As C, is positive under some columns, this solution is not optimal. 


(ii) Now introduce y, and drop A,. Then the revised simplex table is 


C —2 —4 -3 0 0 —M —M 
C. Basis Y, Y, Ys &, S, A, A, b 
-3 Y, -3 0 1 -l 1 1 -l il 
—4 Ys 2 1 0) 0) -l 0) 1 1 
1 —-4 
-3 0 


As all C, < 0, the optimal solution is attained. 


Thus an optimal solution to the dual problem is 

y,=9,y,=1,y,=1, Min. W=- Max. (W’) =7. 

To derive the optimal basic feasible solution to the primal problem, we 
note that the primal variables x,, x, correspond to the artificial starting dual 
variables A,, A,, respectively. In the final simplex table of the dual problem, 
C, corresponding to A, and A, are 3 and 1, respectively after ignoring M. 
‘Thus by rule I, we get opt. x, =3 and opt. x, = 1. 

Hence an optimal basic feasible solution to the given primal is 


x, =3,x, = 1; max. Z=7. 


NOTE Obs. The validity of the duality theorem is therefore, checked 
since max. Z = min. W =7 from both the methods. 


EXAMPLE 12.26 
Using duality solve the following problem: 
Minimize Z = 0.7 x, + 0.5x, 
subject 10%, 24, 4,26, 4, 2x, 220, 2x, x, > 18,42, > 0, 
Solution: 
The dual of the given problem is 
Max. W = 4y, + 6y, + 20y, + 18y,, 
subject to yy Oy = 0.7. Fey ey = 0.5. yy oy 20 
Step 1. Express the problem in the standard form. 
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Introducing slack variables, the dual problem in the standard form be- 
comes 


Max. W = 4y, + 6y, + 20y, + 18y, + Os, + Os,, 

subject to y, + Oy, +y,+ 2y, +s, + Os, = 0.7, 

Oy, ty, + 2y,t+y,+ 0s, +s, = 0.5, y,, ¥,, Y5, 4,2 9. 

Step 2. Find an initial basic feasible solution. 

Setting non-basic variables y,, y,, y,, y, each equal to zero, the basic 
solution is 

Y, =Y.=Y3=Y, = (non-basic), s, = 0.7, s, = 0.5 (basic) 

Since the basic variables s,, s, > 0, the initial basic solution is feasible 

and non-degenerate. 


. Initial simplex table is 


As C, is positive in some columns, the initial basic solution is not opti- 
mal. 


Step 3. Iterate towards an optimal solution. 


(i) Introduce y, and drop s,. Then the new simplex table is 


As C, is positive under some of the columns, this solution is not optimal. 
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(ii) Introduce y, and drop s,. Then the revised simplex table is 


C 4 6 20 18 0 0 
Cy | Basis | oy, Yo Ys Ys 5, 8, b 
18 Y, 2/3 -1/3 0 1 2/3 -1/3 3/10 
20 Ys -1/3 2/3 1 0 -1/3 2/3 1/10 
Z, 16/3 22/3 18 18 16/3 22/3 74/10 
C, —4/3 -4/3 0 0 | -16/3 | -22/3 


As all C,<0, the table gives the optimal solution. 
Thus the optimal basic feasible solution is 
y, = 0, y, = 9, y, = 20, y, = 18 max. W = 7.4 


Step 4. Derive optimal solution to the primal. 


We note that the primal variable x,, x, corresponds to the slack starting 
dual variables s,, s, respectively. In the final simplex table of the dual prob- 
lem. C; values corresponding to s, and s, are — 16/3 and — 22/3, respectively. 


Thus, by rule I, we conclude that 
opt. x, = 16/3 and opt. x, = 22/3. 
Hence an optimal basic feasible solution to the given primal is 
x, = 16/3, x, = 22/3; min. Z= 7.4, 
NOTE Obs. To check the validity of the duality theorem, the student is 


advised to solve the given L.P.P. directly by simplex method and 
see that 


min. Z = max. W = 7.4. 


Exercises 12.7 


Using duality solve the following problems (1—3): 


1. Minimize Z = 2x, + 9x, +x,, 
subject tox, + 4x, + 2x, > 5; 3x, + 2,4 2x, > 4,0. %.4,20 
2. Maximize Z = 2x, +x,, 
subject tox, + 2x, < 10, x, +x, <6,x,-x,<2,x,-2x,<1,x,,x, 20. 


3. Maximize Z = 3x, + 2x,, 


subject tox, +x,21,%,+%,5 7, %, + 2x, = 10,%,<53,%,,%, 20. 
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4. Maximize Z = 3x, + 2x, + 5x, 
subject to x, + 2x, +x, < 430, 3x, + 2x, < 460, x, + 4x, < 420, x,, x,, x, 2 0. 


rp Ngo hg = 
5. Write the dual of the following problem and solve the dual. 
Maximize Z = — 2x, — 2x, — 4x, 
subject to 2x, + 3x, +51, >2. ‘Bx, eo 1h 28, 
oa + 4x, + Gx, ($5, X, Ty Xj 20. 


12.13 Dual Simplex Method 


In Section 12.9, we have seen that a set of basic variables giving a fea- 
sible solution can be found by introducing artificial variables and using the 
M-method or Two-phase method. Using the primal-dual relationships for 
a problem, we have another method (known as Dual simplex method) for 
finding an initial feasible solution. Whereas the regular simplex method 
starts with a basic feasible (but non-optimal) solution and works towards 
optimality, the dual simplex method starts with a basic infeasible (but op- 
timal) solution and works towards feasibility. The dual simplex method is 
quite similar to the regular simplex method, the only difference lies in the 
criteria used for selecting the incoming and outgoing variables, In the dual 
simplex method, we first determine the outgoing variable and then the in- 
coming variable while in the case of regular simplex method the reverse is 
done. 


Working procedure for dual simplex method: 
Step 1. (i) Convert the problem to maximization form, if it is not so. 


(ii) Convert (2) type constraints, if any to (S) type by multiplying such 
constraints by — 1. 


(iii) Express the problem in standard form by introducing slack vari- 


ables. 


Step 2. Find the initial basic solution and express this information in the 
form of dual simplex table. 


Step 3. Test the nature of C,=c¢,—Z; 


(a) If all C, < 0 and all bi = 0, ve optimal basic feasible solution has 
been attained.” 


(b) If all C, < 0 and at least one bi < 0, then go to step 4. 
(c) If any C, > 0, the method fails. 
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Step 4. Mark the outgoing variable. Select the row that contains the 
most negative bi. This will be the key row and the corresponding basic vari- 
able is the outgoing variable. 


Step 5. Test the nature of key row elements: 


(a) If all these elements are = 0, the problem does not have a feasible 
solution. 


(b) If at least one element < 0, find the ratios of the corresponding ele- 
ments of C -row to these elements. Choose the smallest of these ratios. The 
corresponding column is the key column and the associated variable is the 
incoming variable. 


Step 6. Iterate towards optimal feasible solution. Make the key element 
unity. Perform row operations as in the regular simplex method and repeat 
iterations until either an optimal feasible solution is attained or there is an 
indication of non-existence of a feasible solution. 


EXAMPLE 12.27 
Using dual simplex method: 
maximize — 3x, — 2x,, 


subject On +e, 2 1 2 +e, S 7, ore 210 5 3 e 20a 


Solution: 

Consists of the following steps: 

Step 1. (i) Convert the first and third constraints into (S) type. 
These constraints become 

S=1,=¢,=24,5=10, 


1 


X,-X,5 


(ii) Express the problem in standard form 


Introducing slack variables s,, s,,s,,s, the given problem takes the form 
Max. Z = — 3x, — 2x, + Os, + Os, + Os, + Os, 
subject to—x, —x,+s,=-1,x,+x,+8,=7, 


a% 928 +e, == 10,8, +38) 5,2 52,3 $588,820. 
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Step 2. Find the initial basic solution 


Setting the decision variables x,, x, each equal to zero, we get the basic 
solution 
x, =x, =0,s, =—-1,s,=7,s,=-10,s,=3 and Z=0. 


‘. Initial solution is given by the table below: 


C, -3 2 0 0 0 0 
Cs Basis xt, Ry 8 £ Sy S, b 
0 8, —l —l 1 0 0 0 —l 
0 5, I 0 I 0 0 7 
0 5, 1 | 0 0 i 0 0 
5, 0 I 0 0 0 i 3 
Z= 2 C0, 0 0 0 0 0 0 0 
C=c- Z, -3 -2 0 0 0 0 
T 


Step 3. Test nature of C., 


Since all C, values are < 0 and b, =- 1, b3 = — 10, the initial solution is 
optimal but infeasible: We Hierelore. proceed further. 


Step 4. Mark the outgoing variable. 


Since b, is negative and numerically largest, the third row is the key row 
and s, is the outgoing variable. 


Step 5. Calculate ratios of elements in C -row to the corresponding neg- 
ative elements of the key row. 


These ratios are — 3/— 1 = 3, — 2/- 2 = 1 (neglecting ratios corresponding 
to + ve or zero elements of key row). Since the smaller ratio is 1, therefore, 
x,-column is the key column and (— 2) is the key element. 


Step 6. Iterate towards optimal feasible solution. 


(i) Drop s, and introduce x, alongwith its associated value — 2 under c, 
column. Convert the key element to unity and make all other elements of 
the key column zero. Then the second solution is given by the table below: 
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-2 
Basis i a e %, 8. 8, b 

S -1/2 0) 1 0) -1/2 0 4 

Sy 1/2 0) 0 1 1/2 0) 2 

x, }/2. 1 0 0) -1/2 0) 5 

S, -1/2 0) 0) 0 1/2 I! 2 
Z, =z C0, -l -2 0 0 1 0 -10 
C=5-2| 2 0 0 0 =i 0 

i 


Since all C, values are < 0 and b4 = — 2, this solution is optimal but in- 
feasible. We therefore proceed further. 


(ii) Mark the outgoing variable 


Since b,, is negative, the fourth row is the key row and s, is the outgoing 
variable. (iii) Calculate ratios of elements in C-row to the corresponding 
negative elements of the key row. 

This ratio is — = 4 (neglecting other ratios corresponding to + ve or 0 


5) 
elements of key row). 
2 1 
2 
(iv) Drop s, and introduce x, with its associated value — 3 under the c, 
column. Convert the key element to unity and make all other elements of 
the key column zero. Then the third solution is given by the table below: 


. x,-column is the key column and ( is the key element. 


C -3 —2 0) 0) 0) 0) 

G. Basis x, i 2 Ss ‘ 8, b 
0 5, 0 0 i 0 ol = 6 
0 s, 0 0 0 I i i 0 
3 X, 0 i 0 0 0 i 3 
-3 x, 1 0) 0 0 -10 —2 4 
Z, -3 —2 0) 0 3 4 -18 
C, 0 0 0) 0 -3 —4 

Since all C, values are < 0 and all b’s are > 0, therefore this solution 
is optimal and feasible. Thus the optimal solution is x, = 4, x, = 3 and 


Z  =-18. 


max 
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EXAMPLE 12.28 


Using dual simplex method, solve the following problem: 
Minimize Z = 2x, + 2x, + 4x, 
subject to 2x, + 3x, + 5x, 22, 3x, +x, + Tx, <3, 
x, + 4x, + 6x, 5:5, % 5% %,20 
Solution: 
Consists of the following steps: 
Step 1. (i) Convert the given problem to maximization form by writing 
Maximize Z’ = — 2x, — 2x, — 4x,. 
(ii) Convert the first constraint into (S) type. Thus it is equivalent to 


2x, — 3x, 5x, S 2 


1 


(iit) Express the problem in standard form. 


Introducing slack variables s.,, s,, s,, the given problem becomes 


max. Z’ = — 2x, — 2x, — 4x, + Os, + Os, + Os, 


subject to — 2x, — 8x, —-5x, +s, + 0s, + Os, =—2, 3x, +x, + Tx, + Os, + 
s, Us 23) %, 4x, + Ox, + 0s, +08, +S, = 5.4% Nay 80S y3 
5,2 0. 


Step 2. Find the initial basic solution. 


Setting the decision variables x,, x,, x, each equal to zero, we get the 


basic solution 


x, =x, =x, =0,s,=-2,8,=3,s,=5 andZ’=0. 


1 
.. Initial solution is given by the table below: 


C, —2 —2 —-4 0 0 0) 
c, Basis a a x & S 8 b 
0 s, 2 | ©) 5 1 0 0 ae 
0 5, 3 I 7 0 1 0 
0 S, 1 4 6 0) 0 1 5 
Z, 0 0 0 0 0 0 0 
C, —2 -2 4 0) 0 0) 
Se 
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Step 3. Test nature of C,. 


Since all C, values are < 0 and b, = — 2, the initial solution is optimal but 
infeasible. 


Step 4. Mark the outgoing variable. 

Since b, < 0, the first row is the key row and s, is the outgoing variable. 

Step 5. Calculate the ratio of elements of C-row to the corresponding 
negative elements of the key row. 

These ratios are — 2/— 2 = 1, - 2/-3 = 0.67, —4/-5=058. 


Since 0.67 is the smallest ratio, x,-column is the key column and (— 3) is 
the key element. Step 6. Iterate towards optimal feasible solution. 


Drop s, and introduce x, with its associated value — 2 under c, column. 
Then the revised dual simplex table is 


C —2 —2 —4 0) 0 0 
a, Basis a it %, 8 ce . b 
0) X, 2/3 1 5/3 -1/3 0 0 2/3 
0 $5 7/3 0 16/3 1/3 1 0 7/3 
0) S, 5/3 0 —2/3 4/3 0 al 7/3 
; —4/3 —2 -10/3 2/3 0 0 —4/3 
C —2/3 0 -2/3 —-2/3 0 0 


Since all C. < 0 and all a are > 0, this solution is optimal and feasible. 
Thus the optimal solution is x, = 2/3, x, = 0 and max. Z’ = - 4/3 


i.€., min. Z = 4/3. 


Exercises 12.8 


Using dual simplex method, solve the following problems: 


1. Maximize Z =— 3x, —x, 

subject tox, +2, 2 1, 20 +30, > 29a > 0, 
2. Minimize Z = 2x, +x,, 

subject (0:00, x, > 3, 4x, ox = 6.0 or 3 ae 0, 
3. Minimize Z=x, + 2x, + 3x, 


subject to 2x. a, +x, 24. 0 te, On, 884 =e, A 25x, et. 
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4. Minimize Z = 6x, + 7x, + 3x, + 5x, 
subject to 5x, + 6x, — 3x, + 4x, = 12, x, + Sx, — 6x, 210, 
2x, OL, +, ‘+x, > 8, ee, -x,,x,20. 
5. Minimize Z = 3x, + 2x, +x, +4x, 
subject to 2x1 + 4x2 + 5x3 + x4 = 10, 3x] — x2 + 7x3 — 2x4 > 2, 
On, Fix a, F Ox, 215K he BU, 


12.14 Transportation Problem 


This is a special class of linear programming problems in which the ob- 
jective is to transport a single commodity from various origins to different 
destinations at a minimum cost. 


Formulation of a transportation problem. There are m plant locations 
(origins) and n distribution center (destinations). The production capacity 
of the ith plant is ai and the number of units required at the jth destilna- 
tion is b,. The transportation cost of one unit from the ith plant to the jth 
destination i is c,. Our objective is to determine the number of units to be 
transported from the ith plant to jth destination so that the total transporta- 
tion cost is minimum. 


Let X be the number of units shipped from ith plant to jth destination, 
then the general transportation problem is: 


m n 
Minimize Z = > ye Xy 

i=l jel 
subject to the constraints 


x, +X. +++: +x, =4,, for ith origin (i = 1, 2, --- m) 
x, +X, +---+x,=b, for destination (j = 1, 2, --- n) 
yo 3 mj 
x0; 
ij 


Def. 1. The two sets of constraints will be consistent if 


Yan > 


which is the condition for a eae problem to have a feasible solu- 
tion. Problems satisfying this condition are called balanced transportation 
problems. 
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2. A feasible solution to a transportation problem is said to be a basic fea- 
sible solution if it contains at the most (m + n — 1) strictly positive alloca- 
tions, otherwise the solution will degenerate. If the total number of positive 
(non-zero) allocations is exactly (m +n — 1), then the basic feasible solution 
is said to be non-degenerate. 


3. A feasible solution which minimizes the transportation cost is called an 
optimal solution. 


This problem is explicitly represented in the following transportation 
table: 


Distribution centers (Destinations) 


1 2 j n Supply 


: . : . la 
1 an ar) an an HM 
a 
2 Cn 59 C5, C5 i 
H i 
1 
if 
Plants LT im CT I 
(origins) ' Cy ce Cy c,, | “i 
LT LT LT ; 
I 
I 
L a a \ 
m a 
ml Cm2 Cny Conn eS 
Demand b Di sete Dye espera ee b a=b. 


1 2 i n ii 


The mn squares are called cells. The per unit cost c, of transporting 
from the ith origin to the jth destination is displayed in the lower right side 
of the (i, j)th cell. Any feasible solution is shown in the table by entering the 
value of x, in the small square at the upper left side of the (i, j)th cell. The 
various a’s and b’s are called rim requirements. The feasibility of a solution 
can be verified by summing the values of x, along the rows and down the 
columns. 


NOTE Obs. 1. The special features of a transportation problem are 
thet 
(i) the coefficients of all x, in the constraints are unity, and 
(ii) the total supply Xa, = = total demand 2b, 


Obs. 2. The objective function and the constraints being all 
linear, the problem can be solved be the simplex method. But 
the number of variables being large, there will be too many 
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calculations. However, the coefficients of all x, in the constraints 
being unity, we can look for some technique which would be 
simpler than the simplex method. 


12.15 Working Procedure for Transportation Problems 


Step 1. Construct transportation table. Express the supply from the ori- 
gins a,, demand at destinations b, and the unit shipping cost c,in the form of 
a matrix, know as transportation table. If the supply and demand are equal, 
the problem is balanced. 


Step 2. Find the initial basic feasible solution. We find an initial al- 
location which satisfies the demand at each project site without violating 
the capacities of the plants (origins) and also meeting the non-negativity 
restrictions. There are several methods for initial allocations e.g., North- 
West corner rule, Row minima method, Least cost method, and Vogel’s ap- 
proximation method. The Vogel’s approximation method (VAM) takes into 
account not only the least cost c, but also the costs that just exceed the least 
cost cand therefore yields a better initial solution than obtained from other 
methods. As such we shall confine ourselves to VAM only which consists of 
the following steps: 


(i) Display the difference between the least and the next to least costs 
in each row, by enclosing them in brackets to the right of the row. Similarly 
display the differences for each column within brackets below that column. 


(ii) Identify the row or column with the largest difference among all the 
rows and columns and allocate as much as possible under the rim require- 
ments, to the lowest cost cell in that row or column. In case of a tie allocate 
to the cell associated with the lower cost. 


If the greatest difference corresponds to ith row and c,, is the lowest 
cost in the ith row, allocate as much as possible, i.e., min (a, b, i) i in the (i, j)th 
cell and cross off the ith row or the jth column. 


(iii) Recalculate the row and column differences for the reduced table 
and go to the previous step. 


(iv) Repeat the procedure till all the rim requirements are satisfied. 
Note the solution in the upper left corner small squares of the basic cells. 
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Step 3. Apply optimality check. 


In the above solution, the number of allocations must be “m +n — 1”, 
otherwise the basic solution degenerates. 


Now to test for optimality, we apply the modified distribution (MODI) 
method and examine each unoccupied cell to determine whether making 
an allocation in it reduces the total transportation cost and then repeat this 
procedure until the lowest possible transportation cost is obtained. This 
method consists of the following steps: 


(i) Note the numbers wi along the left and vj along the top of the cost 
matrix such that their sums equal to the original costs of occupied cells, i.e., 
solve the equations [u, + v, =c,] starting initially with some u, = 0. 


(ii) Compute the net evaluations w, =u, + v, =e, for all the empty cells 
and enter them in upper right hand corners of the corresponding cells. 


(iii) Examine the sign of each Wy. If all w, < 0, then the current basic 
feasible solution is optimal. If even one w, > 0, this solution is not optimal 
and we proceed further. 


Step 4. Iterate towards an optimal solution 
(i) Choose the unoccupied cell with the largest w, and mark 6 in it. 


(ii) Draw a closed path consisting of horizontal and vertical lines begin- 
ning and ending at 6-cell and having its other corners at the allocated cells. 


(iit) Add and subtract @ alternately to and from the transition cells of 
the loop subject to rim requirements. Assign a maximum value to 6 so that 
one basic variable becomes zero and the other basic variables remain non- 
negative. Now the basic cell whose allocation has been reduced to zero 
leaves the basis. 


Step 5. Return to step 3 and repeat the process until an optimal basic 
feasible solution is obtained. 


EXAMPLE 12.29 


Solve the following transportation problem: 


A B C D 
I 21 16 25 13 11 
Source II 17 18 14 23 13 Availability 


Ill 
Requirement 6 10 12 15 43 
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Solution consists of the following steps: 


Step 1. Transportation table. Here the total availability and the total 
requirement being the same, i.e., 43, the problem is balanced. 


Step 2. Find the initial basic feasible solution. Following VAM, the dif- 
ferences between the smallest and next to the smallest costs in each row 
and each column are computed and displayed within brackets against the 
respective rows and columns (table 1). The largest of these differences is 
(10) which is associated with the fourth column. 


Table 1 Table 2 
a] | asp sfn@ = | a] ts] as |) 
17 18 4 93 | 13 (8) 32 QT 18 ay \ 82) 
32 27 18 4 | 19 9) 6 10 12 4 
6 10 12 15 (15) (9) (4) (18) 


(4) (2) (A) (10) 
Since c,, (= 13) is the minimum cost, we allocate x,,= min (11, 15) = 11. 
This exhausts the availability of first row and therefore we cross it. 


Table 3 Table 4 Table 5 
‘ 3 7 12 P 
17 18 4 | 98) 18 14 | 34) 97 18 Co 
32 27 ig | 19) 27 1s | 190) if 12 
6 10 12 10 12 
(15) (9) (4) (9) (4) 


The row and column differences are now computed for reduced Table 2 
and displayed within brackets. The largest of these is (18) which is against 
the fourth column. Since c,, (= 23) is the minimum cost, we allocate x,, = 
min(13, 4) = 4. 


This exhausts the availability of the fourth column which we cross off. 
Proceeding in this way, the subsequent reduced transportation tables and 
differences for the remaining rows and columns are shown in Tables 3, 4, 
and 5. 


Finally the initial basic feasible solution is as shown in Table 6. 
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Table 6 Table 7 
ll r) 7 2 9° 
21 16 25 13 ~~ » 2 ca 
6 3 4 _ (-) (-) (-) {11 
17 18 14 23 21 16 25 13 
7 2 ; 
32 27 18 4l a2 : ne 
17 18 4 23 
g (-) {4 12 (-) 
32 27 18 4l 
Step 3. Apply optimality check 
As the number of allocations = m + n — | (i.e., 6), we can apply the 


MODI method. 
(i) We have u, + v, = 17, u, + v, = 18, u, + 0, = 27 
u,t+0,= 18,u, +0,=13,u, +0, = 23 
Let u, = 0, then v, = 17, v, = 18, u, = 9, v, = 9, v, = 23, u, =- 10. 


(ii) Net evaluations w,= (a+ v,) =, for all empty cells are 


w,, =—- 14, w,,=- 8, w,, =— 26, w,,=-5, w;, =-6, w,,=-9. 
(iii) Since all the net evaluations are negative, the current solution is 
optimal. Hence the optimal allocation is given by 


x,,= 11, x,,=6,%,,=3,%,,=4,x,,=7 andx,, = 12. 
. The optimal (minimum) transportation cost 


=11x134+6x174+3x 184+4x23+7 x 27412 x 18=$ 796. 


EXAMPLE 12.30 


A company has three cement factories located in cities 1, 2, and 3 which 
supply cement to four projects located in towns 1, 2, 3, and 4. Each plant 
can supply 6, 1, and 10 truck loads of cement daily respectively and the 
daily cement requirements of the projects are respectively 7, 5, 3, and 2 
truck loads. The transportation costs per truck load of cement (in hundreds 
of Dollars) from each plant to each project site are as follows: 


Project sites 


Factories 2, L 0 6 1 


LINEAR PROGRAMMING ° 625 


Determine the optimal distribution for the company so as to minimize 
the total transportation cost. 


Solution consists of the following steps: 


Step 1. Construct the transportation table. Express the supply from the 
factories, demands at sites, and the unit shipping cost in the form of the 
following transportation table (Table 1). Here the supply being equal to the 
demand, the problem is balanced. 


Table 1 


Project sites 


1 2 3 4 Supply 
1 2 3 Il 7 6 
Factories 2 1 0 6 1 1 
3 5 8 als) 9 10 
Demand 7 5 3 2 17 


Step 2. Find the initial basic feasible solution. 


Using VAM, the initial basic feasible solution is as shown in Table 2. 
The transportation cost according to this route is given by 


Z=$(1x24+5x3+1x1+6x5+3x 15+1 x9) x 100=$ 102,00. 
Step 3. Apply optimality check. 


As the numbers of allocations = (m + n — 1), i.e., 6, we can apply the 
MODI method. 


We now compute the net evaluations w,= (u, + v) —c. which are exhib- 
ited in Table 3. Since the net evaluations in two cells are positive, a better 
solution can be found. 


Table 2 Table 3 
I 5 
2 3 ll 7| 6 or 2 3 12 6 
1 “iT 5 + - 
1 0 6 1/1 0 : ’ re s 
6 [3] 1 ES 
5 8 15 g| 10 : OC CQ) @® 
7 io 3 2 1 0 6 1 
6 13 1 
r (-) | 
5 8 15 9 
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Step 4. Iterate towards optimal solution. 
First iteration: 
(a) Next basic feasible solution. 


(i) Choose the unoccupied cell with the maximum w,. In case of a tie, 
select the one with lower original cost. In Table 3, cells (1, 3) and (2, 3) 
each have w, = 1 and out of these cell (2, 3) has the lower original cost 6, 
therefore we take this as the next basic cell and note @ in it. 


(ii) Draw a closed path beginning and ending at @-cell. Add and sub- 
tract 0, alternately to and from the transition cells of the loop subject the 
rim requirements. Assign a maximum value to 6 so that one basic variable 
becomes zero and the other basic variables remain > 0. Now the basic cell 
whose allocation has been reduced to zero leaves the basis. This gives the 
second basic feasible solution (Table 5). 


Table 4 Table 5 
1 5 1 5 
2 3 2 3 ll re 
1 0 6=1] [1-1 
1 0 1 0 6 1 
6 3 6 3-1] [isi 
5 8 5 8 15 9 


.. Total transportation cost of this revised solution. 
=$[1x24+5x34+1x6+6x54+2x 15+2x 9] x 100=$ 101,00. 
(b) Optimality check. As the number of allocations in table 5=m+n-—1 
(i.e., 6), we can apply the MODI method. We compute the net evaluations 


which are shown in Table 6. Since the cell (1, 3) has a positive value, the 
second basic feasible solution is not optimal. 
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Table 6 Table 7 


5 8 15 9 


Second iteration: 

(a) Next basic feasible solution. In the second basic feasible solution 
introduce the cell (1, 3) taking @ = 1 and drop the cell (1, 1) giving Table 7. 
Thus we obtain the third basic feasible solution (Table 8). 


Table 8 Table 9 
i 1 3 u 5 
5 i OB i O 
0 
2 3 11 7 2 Bs 11 7 
1 (-) (-) U2 (-) 
=5 
1 0 6 1 1 0 6 1 
7 I 2 fa © ll 2 
1 
5 8 iS 9 5 8 15 9 


Optimality check. As the number of allocations in Table 8 =m +n —-1 
(i.e., 6), we can apply the MODI method. 


We compute the net evaluations which are shown in Table 9. Since all 
the net evaluations are < 0, this basic feasible solution is optimal. 


Thus the optimal transportation policy is as shown in Table 9 and the 
optimal transportation cost 


=$(5x34+1x11+1x64+7x5+1x15+2 x9] x 100 =$ 10,000 


12.16 Degeneracy in Transportation Problems’ 


When the number of basic cells in a mn-transportation table, is less than 
“m+n — 1” the basic solution degenerates. To remove the degeneracy, we 
assign a small positive value € to as many zero-valued variables as may be 
necessary to complete “m +n — 1” basic variables. The cells containing € 
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are then treated like other basic cells and the problem is solved in the usual 
way. The é’s are kept till the optimum solution is attained. Then we let each 
E> 0. 


EXAMPLE 12.31 


Solve the following transportation problem: 


To 
9 12 9 6 9 10 5 
7 3 7 7 5 5 6 
From 
6 5 9 11 3 11 2 
6 8 il 2 2 10 9 
4 4 6 2 4 2 22 
Solution: 
Consists of the following steps: 
Step 1. Transportation table. The total supply and total demand being 
equal, the transportation problem is balanced. 
Step 2. Find the initial basic feasible solution. 
Using VAM, the initial basic feasible solution is as shown in table 1. 
Step 3. Apply optimality check. Since the number of basic cells is 8 
which is less than m + n — 1 = 9, the basic solution degenerates. In order to 
complete the basis and thereby remove degeneracy, we require only one 
more positive basic variable. We select the variable x,, and allocate a small 
positive quantity € to the cell (2, 3). 
Table 1 
5 
5 
9 12 9 6 9 10 
4 E 2 
6+e=6 
7 3 7 7 5 5 
1 1 
2 
6 5 9 ul 3 u 
3 2 4 
9 
6 8 u 2 2 10 
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We now compute the net evaluations w,= =(u,+0, :) ao which are exhib- 
ited in Table 2. Since all the net evaluations are < 0, Hex cur rent solution is 
optimal. Hence the optimal allocation is 


X13 =9,%5,=4,%,,= 2,5, =1x,,=1, x, =3,x,,=2 andx,, 


2 Al X44 


Table 2 


*. The minimum (optimal) transportation cost 
=5x9+4x34+ex74+2x54+1x64+1x94+3x642x24+4x2 
=112+7e=$11l2ase—5 0. 


Exercises 12.9 


1. Obtain an initial basic feasible solution to the following transportation 


problem: 
To 
D E F G 
A ih 13 17 14 250 
From B 16 18 14 10 300 
C 21 24 13 10 400 
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2. Solve the following transportation problem: 


Suppliers es A B C Available 
! 6 8 4 14 
II 4 9 8 12 
Ill I 9 F 3 
Required 6 10 15 31 


3. Consider four bases of operations B, and three targets T.. The tons of 
bombs per aircraft from any base that can be delivered to any target are 
given in the following table: 


T, 
B j 1 2 3 
1 8 6 5 
2 6 6 6 
3 10 8 + 
4 8 6 + 


The daily sortie capability of each of the four bases is 150 sorties per day. 
The daily requirement in sorties over each target is 200. Find the alloca- 
tion of sorties from each base to each target which maximizes the total 
tonnage over all the three targets. 


4. Solve the following transportation problem: 


Destination 
D, D, D, D, 
O, 1 2 1 4 30 
Origin O, 3 3 2 1 50 Availability 
O, 4 2 5 9 20 
20 40 30 10 100 


nn 


. A company has factories F,, F,, F, which supply ware-houses at W,, W,, 
and W,. Weekly factory capacities, weekly ware-house requirements 
and unit shipping costs (in Dollars) are as follows: 
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Warehouses 
Factories Supply 
Wh Vis ils 
F ; 16 20 12 200 
F 14 18 160 
F ; 26 24 16 90 
Demand 180 120 150 450 


Determine the optimal distribution for this company to minimize ship- 
ping costs. 


6. A company is spending $ 1,000 on transportation of its units from plants 
to four distribution centers. The supply and demand of units, with unit 
cost of transportation are given below: 


Distribution centers 


Plants Availabilities 
Dd, DD, D, Dy, 
cE 19 30 50 12 7 
P, 70 30 40 60 10 
ae 40 10 60 20 18 
Requirements 5 8 vi 15 


What can be the maximum saving by optimal scheduling.? 


7. A departmental store wishes to stock the following quantities of a popu- 
lar product in three types of containers: 


Container type: 1 2 3 
Quantity: 170 200 180 


Tenders are submitted by four dealers who undertake to supply not more 
than the quantities shown below: 


Dealer: 1 2 3 4 
Quantity: 150 160 110 130 
The store estimates that profit per unit will vary with the dealer as shown 
below: 
Dealers > 1 2 3 4 
Container type 
Mi 
1 8 9 6 3 
2 6 11 5 10 
3 3 8 7 9 
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Find the maximum profit of the store. 


. Obtain an optimum basic feasible solution to the following transporta- 


tion problem: 


To 
ie 3 4 2 
2 1 3 3 
} Avai 
From - A 6 5 vailable 
4 1 5 10 
Demand 


. Acompany has three plants A, B, and C and three warehouses X, Y,and 


Z. The number of units available at the plant is 60, 70, and 80, respec- 
tively. The demands at X, Y,and Z are 50, 80, 80, respectively. The unit 
costs of transportation are as follows: 


X Y Z 
A 8 7 3 
B 3 8 9 
C 11 3 5 


Find the allocation so that the total transportation cost is minimum. 


A company has three plants at locations A, B, and C which supply to 
warehouses located as D, E, F, G, and H. Monthly plant capacities are 
800, 500, and 900 units, respectively. Monthly warehouse requirements 
are 400, 400, 500, 400, and 800 units, respectively. Unit transportation 
costs in dollars are given below: 


To 
D E F G H 
A 5 8 6 6 3 
From B 4 7 7 6 6 
G 8 4 6 6 3 


Determine an optimum distribution for the company in order to mini- 
mize the total transportation cost. 


12.17 Assignment Problem 


An assignment problem is a special type of transportation problem in 


which the objective is to assign a number of origins to an equal number of 
destinations at a minimum cost (or maximum profit). 
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Formulation of an assignment problem. There are n new machines M, 
(i = 1, 2, ---n) which are to be installed in a machine shop. There are n va- 
cant spaces S, (j =1, 2, --- n) available. The cost of installing the machine M, 
at space S, is Ci Dollars. Let us formulate the problem of assigning machines 
to spaces so as to minimize the overall cost. 

Let x, be the assignment of machine M, to space S, i.e., let X be a vari- 
able such that 

1, if th machine is installed at th space 
i ~~ |0, otherwise 
Since one machine can only be installed at each space, we have 
x, +X. +-++..+x, =1, for machine M, (i = 1, 2, ...n) 


Ky thy te $y = 1, for space S, (j= 1, 2, ...n) 


n n 
Also the total installation cost is S ye Xi 
i=l j=l 
Thus the assignment problem can be stated as follows: 


Determine x, 2 0 (i, 7 =1, 2, ...n) so as to 


n n 
minimize Z = ) ) Cy Xj 


i=1 j=l 
subject to the constraints 


Sy HL jaL2-+-nand ) ay =13=1,2, Saas n. 


i=l i=1 
This problem is explicitly represented by the following n x n cost matrix: 


Spaces 
S, S, S, parila S, 
M, CH Cis C13 ees ail Cin 
M, Co C59 C53 eras = Con 
Machines M. c C. c C. 
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NOTE Obs. This assignment problem constitutes n | possible ways of 
—— _ installing n machines at n spaces. If we enumerate all these n ! 
alternatives and evaluate the cost of each one of them and select 
the one with the minimum cost, the problem would be solved. 
But this method would be very slow and time consuming, even 
for small value of n and hence it is not at all suitable. However, 
a much more efficient method of solving such problems is 
available. This is the Hungarian method for solution of 
assignment problems which we describe below. 


Working procedure to solve an assignment problem: Step 1. Reduce 
the matrix. Subtract the smallest element of each row (of the given cost 
matrix) from all elements of that row. See if each row contains at least one 
zero. If not, subtract the smallest element of each column (not containing 
zero) from all the elements of that column. This gives the reduced matrix. 


Step 2. Assign the zeros 


(a) Examine rows (of the reduced matrix) successively until a row with 
exactly one unmarked zero is found. Make an assignment to this single zero 
by encircling it. Cross all other zeros in the column of this encircled zero, 
as these will not be considered for any future assignment. Continue in this 
way until all the rows have been examined. 


(b) Now examine columns successively until a column with exactly one 
unmarked zero is found. Encircle this zero and make an assignment there. 
Then cross any other zero in its row. Continue in this way until all the col- 
umns have been examined. 


In case, some rows or columns contain more than one unmarked zeros, 
encircle any unmarked zero arbitrarily and cross all other zeros in its row or 
column. Proceed in this way, until no zero is left unmarked. 


Step 3. Apply optimality check. 
Repeat step 2 (a) and (b) until one of the following occurs: 


(i) If no row or no column is without assignment (encircled zero), then 
the current assignment is optimal. 


(ii) If there is some row and/or column without an assignment, then the 
current assignment is not optimal and we go to next step. 
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Step 4. Find the minimum number of lines crossing all zeros. 
(a) Tick (Vv) the rows which do not have assignments. 


(b) Tick (V) the columns (not already marked) which have zeros in the 
ticked row. 


(c) Tick (V) the rows (not already marked) which have assignments in 
ticked columns. 


Repeat (b) and (c) until no more marking is required. 


(d) Draw lines through all unticked rows and ticked columns. If the 
number of these lines is equal to the order of the matrix then it is an optimal 
solution otherwise not. 


Step 5. Iterate towards an optimal solution. 


Select the smallest element and subtract it from all uncovered ele- 
ments. Add this smallest element to every element lying at the intersection 
of two lines. The resulting matrix is the second basic feasible solution. 


Step 6. Go to Step 2 and repeat the procedure until the optimal solution 
is attained. 


EXAMPLE 12.32 


Four jobs are to be done on four different machines. The cost (in dol- 
lars) of producing ith job on the jth machine is given below: 


M, M, M, M, 
7 15 Wl 13 15 
Jobs | J, 17 12 12 1B 
i. 14 15 10 14 
|, 16 13 Wl 17 


Assign the jobs to different machines so as to minimize the total cost. 
Solution: 
Consists of the following steps: 


Step 1. Reduce the matrix. Subtract the smallest element 11 of row 1 
from all its elements. Similarly subtract 12, 10, and 11 from rows 2, 3, and 
4, respectively. The resulting matrix is as shown in Table 1. Columns 1 and 
4 do not have any zero element. Subtract the smallest element 4 of column 
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1 from all its elements and element 1 from all elements of column 4. The 
reduced matrix is as given in Table 1. 


Table 1 Table 2 
M, M, M, M, M, M, MM, YM, 
J, | 4 0 2 4 | X!I|@I 2 3 


Z| 3 0 0 1 ht} ia | KI} KI ®@ 


JI,| 5 | 2 | 0 | 6 J, a 2 |Q)] 5 


Step 2. Assign the zeros. Row 4 has a single unmarked zero in column 
3. Encircle it and cross all other zeros in column 3. Row 3 has a single un- 
marked zero in column 1. Encircle it and cross the other zero in column 1. 
Row 1 has a single unmarked zero in column 2. Encircle it and cross the 


other zero in column 2. Finally row 2 has a single unmarked zero in column 
4. Encircle it (Table 2). 


Step 3. Apply optimality check. Since we have one encircled zero in 
each row and in each column, this gives the optimal solution. 


. The optimal assignment policy is 

Job 1 to machine 2, Job 2 to machine 4, 

Job 3 to machine 1, Job 4 to machine 3, 

and the minimum assignment cost = $(11 + 13 + 14+ 11) = $ 49. 


EXAMPLE 12.33 


A marketing manager has 5 salesmen and 5 sales districts. Considering 
the capabilities of the salesmen and the nature of districts, the marketing 
manager estimates that sales per month (in hundred Dollars) for each sales- 
man in each district would be as follows: 
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Sales districts 


A B G D E 
1 32 38 40 28 40 
2 40 24 28 2 36 
Salesmen 
3 Al 27 33 30 37 
4 22. 38 Al 36 36 
5 29 33 40 35 39 


Find the assignment of salesmen to districts that will result in maximum 
sales. 


Solution: 
Consists of the following steps: 


Step 1. Reduce the matrix. Convert the given maximization problem 
into a minimization problem, by making all the profits negative, since max. 
Z = min. (— Z). Then subtract the smallest element of each row from the el- 
ements of that row. Now subtract the smallest element of each column (not 
containing zero) from the elements of that column. This gives the reduced 
matrix (Table 1). 


Table 1 Table 2 
: 8 -4-(0)-+-¥é- -7---()- aAnsde tel a@rcbeyeekea 
@)| 14 | 12 | 4 | 4 0 | 10 | 8 | 10 | 0 
©) 2!]s |6| 4 o|s | 4 ]2 ] 0 
1 


= 19 -4--1--F-(0)-F 8G +5 -- se ee el a ee 
= -11-4--5--¢-(0)-F eG ++ 1 -- ABs 5-82 p= O0speOss-sL= 


Step 2. Assign the zeros. Rows 2 and 3 have each a single unmarked 
zero in column 1. Encircle these. Columns 2 and 5 have each a single un- 
marked zero in row 1. Encircle these and cross the zero in row 1. Columns 
3 and 4 have each unmarked zeros. Encircle the zeros in each of the rows 4 
and 5 as shown in Table 1 and cross other zeros. 


Step 3. Apply optimality check. As column 4 is without assignment, this 
solution is not optimal. Therefore we go to next step. 


638 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


Step 4. Find minimum number of lines crossing all zeros. Draw the least 
number of horizontal and vertical (dotted) lines which cover all the zeros. 
Since there are four dotted lines which are less than the order of the cost 
matrix (= 5), we go to Step 5. 


Step 5. Iterate toward an optimal solution. Select the smallest element 
in the Table 1, not covered by the dotted lines. Such an element is 4 which 
lies at two different positions. Selecting the element that lies at position (3, 
5) arbitrarily, subtract it from all the uncovered elements of the cost matrix 
(Table 1) and add the same to the elements lying at the intersection of two 
dotted lines. Now draw more minimum number of dotted lines so as to 
cover the new zero. Here we draw such a line in column 5 (Table 2). 


Now, since the number of dotted lines is equal to the order of the cost 
matrix, the optimal solution is attained. 


Finally, to determine this optimal assignment, we consider only the 
zero elements (Table 3): 


Table 3 
A B G D E 


1 @ | K 
21©@ OK 
3) OK ® 
4 @ | x 
5 «x | @ 


(i) Examine successively the rows with exactly one zero. There is no 
such row. 


(ii) Examine successively the columns with exactly one zero. Column 2 
has one zero, encircle it and cross all zeros of row 1. 


(iit) Encircle arbitrarily the zero in position (2, 1) and cross all zeros in 
row 2 and column 1. Then encircle the unmarked zero in row 3. Now en- 
circle arbitrarily the zero in position (4, 3) and cross all zeros in row 4 and 
column 3. Finally encircle the remaining unmarked zero in row 5. 


Now each row and each column has one encircled zero, therefore the 
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optimal assignment policy is: 
Salesman 1 to district B, 2 to A, 3 to E, 4 to C and 5 to D. 
Hence the maximum sales 


= $ (38 + 40 + 37+ 41 + 35) x 100 = $ 19100. 


Exercises 12.10 


1. A firm plans to begin production of three new products on its three 
plants. The unit cost of producing i at plant is as given below. Find the 
assignment that minimizes the total unit cost. 


Plant 
1 2 3 
1 10 8 12 
Product . is - 7 
3 6 4 2 
2. Solve the following assignment problem: 
1 2 3 4 
A 10 12 19 AT 
B 3 10 7 8 
GC 12 14 13 11 
D 8 15 i) 9 


3. A machine tool company decides to make four sub-assemblies through 
four contractors. Each contractor is to receive only one sub assembly. 
The cost of each sub-assembly is determined by the bids submitted by 
each contractor and is shown in the table below (in hundreds of Dol- 
lars). Assign different assemblies to contractors so as to minimize the 


total cost. 
Contractor 
A B c D 
I 15 13 14 iy 
Sub-assembly II 11 12 15 13 
Il 18 12 10 it 
IV 15 17 14 16 
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4. Four professors are each capable of teaching any one of the four differ- 
ent courses. Class preparations time in hours for different topics varies 
from professor to professor and is given in the table below. Each profes- 
sor is assigned only one course. Find the assignment policy schedule so 
as to minimize the total course preparation time for all courses. 


Prof. | L.P. Queuing Dynamic Regression 
Theory Programming Analysis 
A 2 10 9 7 
B 15 4 14 8 
Cc 13 14 16 11 
D 3 15 13 8 


5. Consider the problem of assigning five jobs to five persons. The assign- 
ment costs are given below: 


Jobs 


Persons 


Determine the assignment schedule. 


6. The head of the department has five jobs A, B, C, D, E and five subor- 
dinates V, W, X, Y and Z. The number of hours each man would take to 
perform each job is as follows: 


How should the jobs be allocated to minimize the total time? 


7. A company has six jobs to be processed by six mechanics. The following 
table gives the return in Dollars when the ith job is assigned to the jth 
mechanic. How should the jobs be assigned to the mechanics so as to 
maximize the over all return? 
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Mechanic Job 
AL 1 I vga IV V VI 
1 9 22 58 11 19 27 
2 43 78 72 50 63 48 
8 4l 28 91 37 45 33 
4 74 42 27 49 39 32 
5 36 if i 22 25 18 
6 13 56 53 31 17 28 


8. A company has four machines on which to do three jobs. Each job can 
be assigned to one and only one machine. The cost of each job on each 
machine is given in the following table: 


fob Machine 
A B C 2) 
1 18 24 28 32 
2, 8 13 17 19 
3 10 15 19 22 


Determine the optimum assignment. 
HINT. Whenever the cost matrix of an assignment problem is not a 
square matrix, the problem is called an unbalanced assignment prob- 
lem. In such problems, we add dummy rows (or columns) so as to form 
a square matrix. Then we solve the resulting balanced problem in the 
usual way. In this problem, we add a dummy fourth row so as to get the 
following balanced assignment problem: 


Machine 
Jen A B é D 
1 18 24 28 32 
2 8 13 17 19 
3 10 15 19 22 
4 0 0 0 0 


9. Determine an optimum assignment schedule for the following assign- 
ment problem. The cost matrix is given: 


13 


16 


Job Machines 
i 2 3 4 5 6 
Il 17 8 16 20 15 
9 7 12 6 15 13 


y 
A 
B 
C 
D 


21 


24 
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E 14 10 12 11 15 6 


12.18 Objective Type of Questions 


Exercises 12.11 


Fill up the blanks in the following questions: 


1. Infeasibility in a linear programming problem means ------ . 


2. The significance of the (Z, - C) row in the simplex solution procedure is 
that ------ : 


3. The duality principle states that ------ . 


4. The difference between the transportation problem and the assignment 
problem is ------ . 


5. The special features of a transportation problem are ------ 
6. The canonical form of an L.P.P. is such that ------ . 


7. The dual problem of the L.P.P: 
Max. Z = 4x, + 9x, + 2x, 


subject to 2x, + 3x, + 2x, <7, 3x, — 2x, + 4x,=5, x, ,x,,X, 2 0, is +--+ . 


1772? "3 


8. The optimality and feasibility conditions related with Dual simplex 
method are ------ - 


9. Feasible and basic solutions related with a transportation problem are 


Supply 
2, 3 Wi 4 15 
5 8 7 20 


Its linear programming problem is ------ 


11. The basic feasible solutions of 2x, +x, + 4x, = 11, 3x, +x, + 5x, = 14 are 


12. 


13 


14. 


15. 
16. 
17. 


18. 


19. 


20. 


21. 
22. 
23. 
24. 


25. 


26. 
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A slack variable is defined as------ . 


. The advantage of the dual simplex method is ------ : 


If the total availability is equal to the total requirements, the transporta- 
tion problem is called ------ . 


An artificial variable is that ------ : 
Two conditions on which the simplex method is based are ------ : 


A feasible solution which minimizes the transportation cost is called an 
seeees - solution. 


The dual problem of: Max.5x, + 6x, subject to x, + 2x, =5, -—x, + 5x, 23, 
x, unrestricted and x, > 0, is -+---- : 


For a balanced transportation problem with 3 rows and 3 columns, the 
number of basic variables will be «+--+. . 


Using graphical method, Max. Z = 5x, + 3x, subject to 5x, + 2x, < 10, 3x, 
+0", S 15, x,, x20, 1S -s-0-- : 


In an L.P. problem, unbounded solution is that ------ . 
Degeneracy in a transportation problem is resolved by ------ . 
A basic solution is said to be non-degenerate in L.P.P. when ----- : 


The dual of the problem Max. Z = 2x, + x, subject to—x, + 2x, <2,x, +4, 


£4, 0,53,%.%,20/18 sidisietes , 
The two methods used to find the initial solution of a transportation 
problem are ------ . 


Constraints involving “equal to sign” do not require use of ------ OF vse 
variables. 


CHAPTER 


A Brief REVIEW OF COMPUTERS 


Chapter Objectives 

e Introduction 

e Structure of a computer 

e Computer representation of numbers 

e Floating point representation of numbers 

e Computer calculations: algorithm, flowchart 


e Program writing 


13.1. Introduction 


Many problems in modern science and engineering involve so 
much of computation that they would require years of labor for 
their solution even using the best of calculators. With the advent of 
high speed computers, the picture has changed completely. Such 
complicated problems can now be solved very quickly by using 
electronic computers. For instance, a system of thirty linear equa- 
tions with thirty unknowns is a monstrous problem for a human be- 
ing but it is just a routine job for a digital computer. In fact, modern 
numerical techniques can best be appreciated within the context of 
some basic knowledge of computers. As such, a concise introduc- 
tion to the digital computer is given in this chapter. 
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13.2 Structure of a Computer 


A digital computer has the following interconnected units each of which 
performs a specific task: 


(i) 


Input unit accepts (or reads) the data and instructions which are 
typed using a keyboard of video display unit. It consists of a mag- 
netic tape (or disk). 

Memory unit stores the data and procedures. It consists of mag- 
netic cores or semi-conductor storage. 


Central Processing Unit (C.P.U.) is the vital component that 
makes the computer work. It takes care of all arithmetic and logi- 
cal operations. It comprises of the following two parts: 


(a) Control unit interprets and carries out the instructions stored 
in the memory. It has electronic circuitry to decode instruc- 
tions and activates other units. 

(b) Arithmetic unit carries out the required calculations. It con- 
sists of electronic registers, accumulators. 

Output unit presents the results of the calculations. It consists of 

a video display terminal and a printer. Various discs as input as 

well as output devices. 


Program 


ne ad 
anddata 


Results 
Input > Memory -——>, Output = -——~> 


FIGURE 13.1 


A 


Control 9 ff) 7777 7777 
unit 
T 


CPU. 
Y 


Arithmetic 
unit 


The memory and control units deal with numbers. So they must have 
a method of recording numbers. Such a recording is achieved by the mag- 
netic cores or semi-conductor storage which require the numbers to be 
made up of zeros and ones only. 
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13.3. Computer Representation of Numbers 


The numbers are first converted to machine numbers consisting of 0 
and 1 with a base depending on a computer. Most of the computers have 
a base 2 which is called a binary system of numbers. The decimal system 
has the base 10. We, therefore, convert the decimal numbers into the bi- 
nary system for the input and reconvert the binary numbers to the decimal 
form for the output. 


Binary numbers. Any number is written in binary notation as 


bP _ bb. b, Ds : = b_, (A) 


where b’s are binary bits 0 or 1 and the point is the binary point. 


Rule I. To convert the binary number (A) to the decimal form, use the for- 
mula: 


Bg Pt get DBE DD 2 ep 2 ee 
Rule II. To convert an integer to a binary number: 
(i) divide it by 2 and write the remainder, 
(ii) continue the process until the quotient is zero, 


(iii) write the remainders from bottom to top. This will give the re- 
quired binary equivalent. 


Rule III. To convert a decimal number to a binary fraction: 
(i) multiply the given number by 2 and separate the integral part, 
(ii) multiply the fractional part again by 2 and separate the integral 
part, 
(iii) continue this process, until the fractional part reduces to zero, 


(iv) write the integral parts and prefix the binary point. This will be the 
desired binary fraction. 


EXAMPLE 13.1 


Find the decimal number corresponding to the binary number 
1101001.1110011. 

Solution: 

(1101001. 1110011), =1 x 26+1 «x 2°+0x 24+1 x 22+0 x 2? 


2 


£04914 129941 % 024149241 49740424 


648 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


+0x2°4+1x2%4+1x 27 


[Rule I] 


= 64+32+8+4+1+40.5 + 0.25 + 0.125 + 0.015625 + 0.0078125 
= (105.8984375),,, 


EXAMPLE 13.2 
Convert 78.59375 to the binary system. 
Solution: 
We first convert 78 to binary form using Rule II. 
78 = 1001110 


Then we convert .59375 to the binary fraction using Rule III. 


0.59375 = 0.10011 


Hence (78.59375),, = (1001110.10011), 
Verification: Using Rule I, 


(1001110.10011), 


=] x 2°+0 x 2°+0 x 24+1 x 2° 
+1 x 2?4+1~x2'+0~x 2° 
+1x21+0x27°4+0x 2° 
+1x2*+1x2° 

= 78.59375 


Some of the computers have a base 8 which is called the oc- 
tal system and uses the symbols 0, 1, 2, 3, 4,5, 6, 7. As 8 = 2°, 
a group of three binary bits can be represented by an equivalent 
octal digit. Equivalence between the octal and binary systems 
is given below: 


Octal: 


il 


2 


3 


4 


5 


Binary: 


O01 


010 


O11 


100 


101 


2 
2 
2 
2 
2 
2 
2 


0.59375 


x2 


1 0.18750 


x2 


0 0.037500 


x2 


0 00.75000 


x2 


1 0.50000 


x2 


1 0.00000 


Another base commonly used is 16 which is known as hexadecimal. 
The symbols used are 0 to 9 and A, B, C, D, E, F. As 16 = 2%, a group of 
four binary bits can be represented by an equivalent hexadecimal symbol. 
Equivalence between hexadecimal and binary numbers is as follows: 
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Hexa: 0) 1 vy) 3 4 5 6 7 


Binary: | 0001 0010 0011 0100 0101 0110 O111 
0000 


Hexa: 8 9 A B C D E F 


Binary: 1001 1010 1011 1100 1101 1110 1111 
1000 


EXAMPLE 13.3 


Convert the binary number 1011101.1100101 to the octal and hexa- 
decimal systems. 


Solution: 
(i) Given number =(001 011 101.110 010 100), 


= (135.624), i.e., octal equivalent. 
(ii) Given number al 1101 . 1100 ae 


= (5D.CA),,i.e., hexa. equivalent 
=5~x 16'+13 x 16°+ 12 x 16'+10 x 16° 
= (93.7890625),, i.e., decimal equivalent. 


13.4 Floating Point Representation of Numbers 


The memory of a digital computer has separate cells called “words.” 
Each word contains the same number of binary digits called “bits.” The 
number of digits which can be stored in a computer is known as its word 
length. The numbers are stored in a computer in two forms: fixed-point and 
floating-point forms. The fixed point mode is used to represent integers 
while the floating-point mode is used to represent real numbers. 


A floating-point number is of the form 
dd AD 
where d.,, d,,---, dn are all digits in the base “b” of the number system used 
and lie hetween o and b. The exponent m is such that M, < m < M, where 


M, and M, vary with the computer. The fractional part a id,-+: d, is called 
the mantissa which lies between +1 and restricts the size of a dagen Ifa 
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floating-point number has a fixed mantissa of k digits, we say that the word 
length of the computer is k. 


For instance, the number 33.74 x 106 is represented as .3374E8 (E8 is 
used to represent 108). Hence the mantissa is .3374 and the exponent is 8. 
While storing numbers, the leading digit in the mantissa is always made non- 
zero by suitably shifting it and adjusting the value of the exponent accord- 
ingly. This process is called normalization. Therefore the number.003374 
in normalized floating point mode would be stored as .3374E-2. 


Thus the shifting of the mantissa to the left until its most significant 
digit is non-zero is called normalization. 


Obs. To perform arithmetic operations with numbers in 
normalized floating point modes, we assume a hypothetical 
computer with a four decimal digit mantissa. 


NOTE 


Arithmetic operations 


(i) To add two numbers represented in normalized floating point nota- 
tion, we make their exponents equal by shifting the mantissa appropriately. 


The operation of subtraction is nothing but addition of a negative num- 
ber. After addition/subtraction of the mantissas, the resulting mantissa is 
normalized and the exponent is suitably adjusted. 


EXAMPLE 13.4 
Evaluate (a).6756E4 + .7644E6 (b).4546E-4 — .8524E-5, 
Solution: 


(a) The exponent of the number with the smaller exponent is increased 
by 2 so that .6756E4 becomes .0067E6. 


Thus .6756E4 +.7644E6 =.0067E6 +.7644E6 = 0.771 1E6. 
(b) Increasing the exponent of .8524E-5 by 1, it becomes .0852E-4. 
Thus .4546E-4 — .8524E-5 = .4546E-4 — .0852E-4 = .3694E-4. 


(ii) To multiply two numbers given in the normalized floating point 
mode, we multiply their mantissas and add their exponents. 


After multiplication of the mantissas, the resulting mantissa is normal- 
ized and the exponent is suitably adjusted. The mantissa is only four digits 
of the resulting mantissa which is retained by dropping the rest of the digits. 
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EXAMPLE 13.5 
Evaluate (a).6543E11 x .5123E-14 (b).1234E12 x.1111E9. 
Solution 
(a).6543E11 x .5123E-14 = .33519789E-3 = .3351E-3. 
(b).1234E12 x.1111E9 = .0137097E21 = .1370E20. 


(iit) To divide a number by another, the mantissa of the numerator is 
divided by the mantissa of the denominator and the denominator exponent 
is subtracted from the exponent of the numerator. The quotient mantissa 
is then normalized retaining four digits and the exponent adjusted suitably. 


EXAMPLE 13.6 
Divide.1000E5 by.8889E3. 


Solution: 
“» 1OOOE5 + .SS8S9E3 = .1124E2. 


Obs. While performing the arithmetic operations with numbers 
in normalized floating-point mode, the numbers have to be 
truncated to fit the four digit mantissa of our hypothetical 
computer. This leads to results with wide disparity. In fact, the 
associative and distributive laws do not yield valid results in 
floating point representation, i.e., 
l+m—n#(l-n)+mandl(m—n)4lm-—lIn. 


For instance, if] = .6776E1, m = .6667E — 1 andn = .6755E1, then 
(1+ m) —n = (.6776E1 +.0067E1) — .6755E1 
= .6842E1 —.6755E1] = .0087E1 =.8700E-1. 
But (l—n)+m= (.6776E1 —.6755E1) + .6667E-1 
= .0021E1 + .6667E-1 = .2100E-1 + .6667E-1 
= 8767E-1 
“. We see that (1+m)—-n #4 (l-—n) +m. 


NOTE 


In fact, the correct answer is.8767E-1 because no number has been 
truncated. Thus inaccuracies creep in floating point arithmetic due to trun- 
cation of numbers. As such utmost care should be taken before accepting 
the validity of a computer solution. Moreover, we can never ensure exact 
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equality of a number to zero because most of the numbers in floating-point 
mode are only approximations. 


13.5 Computer Calculations 


Algorithm. Once the method of calculation has been decided, we must 
describe clearly the computational steps to be followed in a particular se- 
quence. These steps constitute the algorithm of the method. 


Flow chart. A pictorial representation of a specific sequence of steps to 
be used by a computer is called a flow chart. It is essentially a convenient 
way of planning the order of operations involved in an algorithm and helps 
in writing a program. The programmer, then knows clearly where to start, 
what information to use, what operations to be carried out, and in which 
order and where to stop. As such a flow-chart is additional help for writing 
the program in any language. 


A flow-chart contains certain symbols to represent the various opera- 
tions. These symbols are connected by arrows to indicate the flow of infor- 
mation. The commonly used symbols and their meanings are given below: 


A symbol used to indicate “Start” or “Stop/End” of a program. It is also 
used to mark end of a “Subprogram.” In that case “Return” is written in it. 


[In FORTRAN the subprograms are functions and subroutines while in 


“C” these are functions only. | 
A parallelogram is used to indicate an “Input” or 


“Output” of data. 


Read A, B, C 


A rectangle is a processing symbol, e.g., addition, poe 
” 7 or Frin 


subtraction and movement of data to computer mem- 
ory. 

A diamond is a decision-making symbol. A particular 
path is chosen depending on the “Yes” or “No” answer. 


D=A+B-C 


A small circle with any number or letter in it, is used as a connector 
symbol. It connects various parts of a flow-chart until that are far apart or 
spread over pages. 


A rectangle with double vertical sides is used to denote a subprocess 
which is given else-where as indicated by the connector symbol. When this 
box is encountered the flow goes to the subroutine and it continues until a 
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“Return” statement is encountered. Then it goes back 
to the main flow chart and flow resumes onward pro- 
cessing. 


The flow chart can be translated into any computer 
language and can be executed on the computer. 


The flow-chart can be translated into any comput- 
er language and can be executed on the computer. (c) 


EXAMPLE 13.7 


Develop a flow chart to select the largest number of a given set of 500 
numbers. 


Solution: 


¥ 
Read n 
Y 


Max =n 
Count = 1 


Count = Count + 1 


© 
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This technique of finding the largest number, i.e., assuming the 
first element in the list is the maximum and then scanning the 
rest of the list for anything greater is used in Section 14.12, and 
Section 15.12. 


NOTE 


EXAMPLE 13.8 


Draw a flow chart for computing the roots of the quadratic equation 
ax2+bx+c=0. 


Solution: 

We know that its roots are given by 
_-b+vd _-b-Va 
~ 9a 72 8 
Flow-chart: 


Xy where d = b? — 4ac. 


Yes 
Isa = 0? 
Y 
No Yes 
Y Is b = 0? 
d= b? —4ac 
No 
Y 
Yes x, =-c/b 
Isd< 0? 
: Y 
No Printcomplex 
Y Roots Print x, 
x, =(-b + Vd)/2 
< =(—b — 2 —« 
x, =(-b Vd)/2 y 
Print x,, x, 


NOTE = This method of finding the roots is used in Section 14.6. 
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Exercises 13.1 


1. Convert the following binary numbers to decimal form: 


(a) 1101101 (b) 0.11011 
(c) 0.1010101 (d) 1.0110101. 
2. Convert the following decimal numbers to binary form: 
(a) 22.625 (b) — 10.125. 
3. Show that 
(a) (176), = (126), (b) (17AB),, = (6059)... 


4. IfA = (111010), and B = (1011),, evaluate A + B and A —-B. 


5. Find the product of the binary numbers 
(a) 10101 and 110 (b) 11.1101 and 101.101. 


6. Add the numbers 83.72 and 1.529 in a decimal computer with a fixed 
word length of four. Find the absolute and relative errors involved. 


7. Draw a flow chart to evaluate 
14+4+7+--- +1003. 


8. Draw a flow-chart to pick up the largest of three given distinct numbers. 


9. Draw a flow-chart to arrange a given set of N numbers in an ascending 
order. 


13.6 Program Writing 


Based on the flow chart, we write the instructions in a code that the 
computer can understand. A series of such instructions is called a program. 
If there are any errors in the program these will be pointed out by the 
computer during compilation. After correcting the compilation errors, the 
program is executed with the input data to check for logical errors which 
may be due to misinterpretation of the algorithm or due to incorrect usage 
of computer language. The process of finding the errors and correcting 
them is termed debugging. 


While writing a program, our aim should be that the same program is 
able to run on any machine with the minimum number of modifications. 


CHAPTER 


NUMERICAL METHODs USING 
C LANGUAGE 


Chapter Objectives 
e Introduction 
e An overview of “C” features 


e 3-30 Programs of standard methods in “C” language. 


14.1. Introduction 


C is a general purpose programming language, originally de- 
signed by Dennis Ritchie in 1972 at Bell laboratories. In 1988, it 
was standardized by the American National Standards Institute 
(ANSI) and named as ANSI C. 


C, a powerful language, is used for many purposes like writing 
operating systems, business and scientific applications and even the 
C compiler itself. It is not tied to any particular hardware and pro- 
grams written in C are portable across any system. The programs 
written in C are efficient and fast. It is one of the most popular 
computer languages today. 


An overview of C features is given below for ready reference. 
It is followed by Programs of Standard Numerical methods in C 
language alongwith input/output of numerous examples solved in 
Chapters | to 12. 
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14.2. An Overview of “C” Features 


C constants are numbers, which do not change during execution of a pro- 
gram. These may be of three types: 


Type Example 
Integer 27, 10897 etc. 
Floating point (Real) 2..723, — 0.123 ete. 
String “Enter the value” 


NOTE The string constants are enclosed in double quotes ("). 


C variables can contain different C constants during the execution of the 
pro- gram. These are declared in a C program by first specifying the type int 
for an integer and float for the floating point and then the variable names 
separated by commas. The general format is 


type list of variables 
For e.g., to declare integer variables the statement is 
int a, b,c; 
and to declare a floating point variables it is 
float a, b,c: 


Variables can be initialized at the same time as they are declared. For 
example, 


float a = 1.5; 
declares a as a float variable having a value 1.5. 
Rules for naming C variables: 


(i) A variable name may contain only alphabets, digits, and the under- 
score (_). 


(ii) It must begin with a alphabet or an underscore. 
(iii) It can be as long as you wish, but on some C systems only the first 


thirty-one 31 characters are considered. 


NOTE  Lower-case and upper case alphabets are treated as different 
in C. For e.g. Num and num are two entirely different variable 
names. As a matter of convention, lower- case alphabets are used. 
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Arrays. An array is an aggregate of variables of the same type. These vari- 
ables are called elements of the array. The following statements declare 
arrays in C: 


int b[10]; 
float —c[2][2]: 


The first statement creates a one dimensional array named b having 
ten elements, each element being referred by an appropriate subscript in 


rectangle brackets, i.e., b[0], b[1]......., b[9]. 


The second statement creates a 2-dimensional array named c having 
four elements c[0][0], c[0][1], c[1][0], c[1][1]. 


Rules for the naming of arrays are same as those for variable names. 


NOTE Subscripts always start from zero in C. 


User defined types. Apart from the built in types int and float C allows 
users to define an identifier that can represent an existing data type. 


The syntax is 
typedef type identifier 
For e.g., 
typedef int number; 
typedef float matrix [2][2]; 


The first statement defines number to mean the same as int. The sec- 
ond defines ma- trix to be mean the same as 2 x 2 array of float. 


The above two statements enable declarations of the form number a, 


b,c: 
which declares three integers a, b and c, and 
matrix x; 


which declares a two-dimensional array x having four elements x[0][0], x[0] 


[1], x[1][0] and «[1][1]. 
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Initialization of arrays at the time of declaration 
The syntax is 
type array-name [size] = {list of values} 
fore.g., int a[2] = {2, 1}; 
initializes a[0] to 2 and a[1] to 1. 
int a[2][2] = {{0, 1}, {3, 5}; 
initializes a[0][0] to 0, a[0] [1] to 1, a[1][0] to 3 and a[1][1] to 5. 


Arithmetic operators. These are as follows: 


Symbol Use 
+ Addition 
- Subtraction 
* Multiplication 
/ Division 


while using the operators, the following order of precedence is adopted 


In this case, the order of operators is that different circular brackets are 
used. 


There is no exponentiation operator in C, but there are various library 
functions avail- able for the same. 


For e.g., to calculate the square root sqrt function is used. 

Further details on functions are presented later. 
Mathematical expressions consist of a sequence of arithmetic operators 
and variable names. For e.g., 


(i) a + b is written as a + b. (ii) pte 


is written as a/a + b 


a 
b+c 
(iv) Vb? —4ac is written as sqrt (b*b — 4*a*c). 

(v) a(B + y) is written as alpha * (beta + gamma). 


(vi) a’ is written as exp (b*In (a)) 
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The multiplication operator * has to be written explicitly. In C, 


NOTE . 
——__ its presence is never assumed. 


exp and In are library functions. 

Arithmetic statements are of the form 
var = exp; 

where var is an integer or a floating point variable. 

exp is a mathematical expression written in C format. 

The = sign has a special meaning. It tells C to calculate the value of exp. 
and assign it to var. 

For eé.g., n=i* i; 

calculates the value of i * i and assigns the result to the variable n. If 
i = 10, then n gets the value 100. 


AC statement is always terminated by a semi colon (; ). 
C also permits statements of the type k = n =i * i; 


This is equivalent to the following statements n = i * i; k = n; 


NOTE | 7o test the equality of two expressions C uses “= =”. 


Shorthand assignment operators 

Apart from the assignment operator =, C can also support certain short 
hand assignment operators (+ +,-—, + =,-— =, * =, / =). Their use is illus- 
trated by the following examples. 


Statement using the Statement using the 
assignment operator shorthand assignment operator 
a=a+l a++or++a 
a=a-l a—-or--a 
a=a+4 a+=4 
a=a-4 a—=4 
a=a*4 a*=4 


a=a/4 a/=4 
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NOTE The use of shorthand assignment operators not only results in 
concise programs but more efficient programs also. 


Comments in C start with “/ *” and end with “* 7”. 
For e.g. / * Euler’s Method * /. 
Input statement is scanf. 
syntax scanf (“control string”, & variable 1, & variable 2.......); 


The control string contains the format of the data being input by the 
user. It contains 


%d for an integer, and 
%f for a floating point type. 


The ampersand (&) symbol is necessary before the integer or floating- 
point type variable. Its significance is discussed under functions. 


An example of the scanf statement: 
Assuming the declarations 
int c; 
float a[3][3]; 
the statement 
scanf (“%d %f”, & c, & a[1][2]); 
takes input from the user and stores it in the corresponding variables 
%d corresponds to c, 
%f corresponds to a[1][2]. 
Output statement is printf. 
Syntax printf (“control string”, argument 1, argument 2.......); 


The arguments can be C constants or variables. The control string can 
consist of 


(i) The characters that will be printed as such. 
(ii) Format specifications for variables. 


(iii) Escape sequences. 
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Format specifications 
for integers % w d 

where w specifies the minimum width (i.e., number of digits) for output for 
floating point % w.p £ 


where p is number of digits to be displayed after the decimal point, after 
rounding off if necessary. In this w includes the decimal point too. 


If width of the number is less than the specified width, the number is 
right justified in that width. However if width of the number is greater than 
the specified width, it will be printed in full. 


Escape sequences. These are sequence of two characters meant for 
performing special tasks. The first character is always a back slash (\). 


The most commonly used escape sequence is \n. It causes the output 
to start from next line. 


An example of the printf statement: 
For e.g., Assuming the declarations 
inti = 1; 
float a = 27.23; 
the statement 
printf (“%3d\n %8.2f \n”, i, a); 


will output 
P bb1 


bbb27.23 
where b is a blank space. 


Relational operators available in C are: 


Mathematical symbol C symbol 
> > 
= >= 
< < 
< <= 
# | = 


Logical expressions are mathematical expressions connected by relation- 
al operators. Their value is either true or false. 
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Examples of logical expressions: Assuming i = 2, j = 3 
i <j is true 
i= =7 is false 
(i *j) > @ +)) is true. 


In C the result of a logical expression is an integer. 0 is taken as false, 
any non-zero integer is taken as true. 


Logical operators are used to test more than one conditions i.e. , to com- 
bine more than one logical expressions. 


Logical operator C symbol 
AND && 
OR | 
NOT ! 
The following tables illustrates their use. 
AND 
Logical expression 1 Logical expression 2 Result 
True True True 
True False False 
False True False 
False False False 
OR 
Logical expression 1 Logical expression 2 Result 
True True True 
True False True 
False True True 
False False False 
NOT 
Logical expression Result 
True False 


False True 
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Decision making statement—If 
Syntax 
if (Lexp) 
{Tstatements} 
else 
{Fstatements} 
where Lexp is a logical expression. 
Tstatements are C statements executed when value of Lexp is true. 


F statements are C statements executed when value of Lexp is false. 


The else part is optional. 


Loops 

i) While Loop 

Syntax 

a) while (Lexp) 
{statements} 

b) do 
{statements} 
while (Lexp) 


Both of these forms of the while loop cause execution of statements 
while value of Lexp is true. The difference between the two forms is that 
in the latter, the statements are executed at least once irrespective of the 


value of Lexp. 
(ii) For loop 
syntax 


for (initialization statement; Lexp; increment statement) 


{statements} 
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The loop is best explained by the following flow chart: 


! 


Initialization statement 


! 


Rest of the program 


Statements 


Increment statement 


Break statement. When a break statement is encountered inside a loop, 
that loop is exited, irrespective of the value of Lexp, and the program con- 
tinues with the statement immediately following the loop. 


Functions. These are the basic block of a C program. Functions contain 
State- ments that specify what is to be done. 


Every (program has to contain a function named main. The program 
begins executing at the first statement of main. Apart from main the C 
functions are classified into 


— Library functions 
— User defined functions 
These functions are called from main to accomplish various tasks. 


(i) Library functions are already available and we just have to use them. 
e.g., printf, scanf, sqrt, cos, sin, fabs (used to get the absolute value 
of a floating point variable) etc. 


(ii) User defined functions have to be written by the user in the program. 
Syntax 


return-type function-name (Argument-list) 


{ 
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statements 


} 


Program for understanding the various terms and concepts related with 
functions: 


1./* Sample program * / 
2. # include < stdio.h> 

3. float add (float a, float x); 
4. void half (float *x) 


| 
6. sf So 
7. return; 
8. } 
9. main ( ) 
10. { 


11. float a = 2,b = 2,¢; 

12.c = add (a, b); 

13. print (“%f % f %f\n”, a, b, c); 
14. half (&a); half (&b); 

15. printf (“&f &f &f\n”, a, b, c); 
16. } 

17. float add (float a, float x) 

18. { 

19. float sum; 

20. sum =a + x; 

21. a = 20, x = 20; /*changing the formal arguments*/ 
22. return sum; 

23, } 


[Line numbers have been added for reference purpose and are not part 
of the program. | 
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NOTES: 
(a) Declaration and Definition 


Line number 3 is the declaration of the function named add. It indi- 
cates that there is a function add which takes two arguments a and b both 
of type float and returns a float. i.e., the Argument list is float a, float b and 
return-type is float (which can be void if function doesn’t return anything— 
see line 4. It also indicates that the function is defined later in the program). 


Lines 17-23 are the definition of the function add i.e., they define how 
the function will make use of the arguments it received and return the re- 
quired sum. 


Lines 4-8 constitute both the declaration and definition of the function 
half. 


(b) Calling a function 


Line number 12 calls the function add with a and b as arguments and 
stores the value returned by it into the variable c. 


(c) Actual and Formal arguments 


The variables a and x in the declaration of function add are called the 
formal arguments (line 3). 


The variables a and b in the call to the function (line 12) are the actual 
arguments. 


(d) Call by value/Call by reference 


In C language the values of actual arguments are always copied to the 
formal arguments when a function is called. This way of passing arguments 
is called call by value. In this any change made to the formal arguments in 
the function does not affect the value of actual arguments. 


But in other languages, notably FORTRAN any change made to the for- 
mal arguments is reflected in the actual arguments. This is called call by refer- 
ence, as the formal argument is treated as just another name for the actual ar- 
gument. Both of them refer to the same location in the computer’s memory. 


(e) Simulating a call by reference in C 


The following thumb rule can be followed to make the formal argu- 
ment refer to the actual argument (and not just receive a copy of it) 


“Precede the actual argument with an ampersand & (line 14) and pre- 
cede the formal argument with an asterisk * (line 4).” 
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The actual working of this involves the concepts of pointers, which are 
another data type in C. The reader can refer to any standard C book for a 
complete understanding. 


(f) Return statement in a function passes the control back to the call- 
ing function along with the calculated value (line 22) 


Syntax return expression; 


The expression can be omitted, in this case the return statement causes 
the function to just terminate then and there and pass control back to the 
calling function (Line 7). 


In case no return statement is present in a function, an implicit return 
takes place on encountering the right curly brace } (For e.g., in the function 
main, the control passes back to the caller, i.e., the operating system in this 
case after line 16). 


Preprocessor directives. The lines in a C program that begin with a hash 
(#) sign are called preprocessor directives. The two most commonly used 
are # define and # include. 


NOTE There is no semi colon (; ) after the directive. 


(i) # define 
syntax 
# define name replacement 


It instructs the computer to replace all occurences of name with the 
replacement even before the program is processed, i.e., checked for syntax. 


For e.g., consider the following statements 
# define N 2 
int a[N]; 


Before the program is processed by the compiler, the second line i.e., 
int a[N]; is changed to int a[2]; and the first line is removed. 


.. The resulting statement that is processed is int a[2]. 
(ii) # include 
syntax 


# include < header-file-name > 
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This instructs the computer to insert the contents of the mentioned 
header file at the place where the directive appeared. 


NOTE | Zhe header file contains declarations of various functions and 
many preprocessor directives. 


Dynamic memory allocations. In today’s world utilization of memory 
resources is needed for efficient programming. We may come across situa- 
tions where we may have to deal with data, which is dynamic in nature. The 
number of data items may change during the executions of a program. The 
number of customers change during the process at any time. When the list 
grows we need to allocate more memory space to accommodate additional 
data items. Such situations can be handled more easily by using dynamic 
allocation. Dynamic data items at run times, thus optimizing file usage of 
memory space. 


The process of allocating memory at run time is known as dynamic 
memory allocation. Although “C” does not inherently have this facility 
there are four library routines which allow this function. 


Many languages permit a programmer to specify an array size at run 
time. Such languages have the ability to calculate and assign during execu- 
tions, the memory space required by the variables in the program. But “C” 
inherently does not have this facility but supports with memory manage- 
ment functions, which can be used to allocate and free memory during the 
program execution. The following functions are used in “C” for purpose of 
memory management. 


Function Task 

malloc Allocates memory requests size of bytes and returns a pointer of the 
allocated space 

calloc Allocates space for an group of elements initializes them to zero and 
returns a pointer to the memory 

free De allocates previously allocated space 

realloc Modifies the size of previously allocated memory. 


Memory allocations process. According to the conceptual view the 
memory is partitioned in four different parts: in first part program instruc- 
tions are stored, second global variables, third is used for function calls 
return address, arguments and local variables which are stored in stacks and 
last is called heap and is used for dynamic allocation during the execution 
of the program. 
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Allocating a block of memory. A block of memory may be allocated us- 
ing the function malloc. The malloc function allocates a block of memory of 
specified size and returns a pointer of type void. 


ptr= (type*) malloc (size); 


ptr is a pointer of type the malloc returns a pointer (of type) to an area of 
memory with size. The general form of calloc is: 


Example: 
x= (int*) malloc (2* sizeof (int) ); 


On successful execution of this statement a memory equivalent to two 
times the area of int bytes is reserved and the address of the first byte of 
memory allocated is assigned to the pointer x of type int. 


Allocating multiple blocks of memory. Calloc is function that is nor- 
mally used to allocate multiple blocks of storage each of the same size and 
then sets all bytes to zero. The general form of calloc is: 


ptr= (type*) calloc (n, elem-size); 

The above statement allocates contiguous space for n blocks each size 
of elements size bytes. All bytes are initialized to zero and a pointer to the 
first byte of the allocated region is returned. If there is not enough space a 
null pointer is returned. 


Freeing the used space. Compile time storage of a variable is allocated 
and released by the system in accordance with its storage class. With the 
dynamic runtime allocation, it is responsibility of programmer to free the 
allocated space when it is not re- quired. The release of storage space be- 
comes important when the storage is limited. When we no longer need the 
data we stored in a block of memory and we do not intend to use that block 
for storing any other information, we may release that block of memory for 
future use, using the free function. 


free (ptr); 
ptr is a pointer that has been created by using malloc or calloc. 


Data structure. In computer science, a data structure is a particular way of 
storing and organizing data in a computer so that it can be used efficiently. 
Different kinds of data structures are suited to different kinds of ap- 
plications, and some are highly specialized to specific tasks. For example, 
B-trees are particularly well- suited for implementation of databases, while 
compiler implementations usually use hash tables to look up identifiers. 
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Data structures are used in almost every program or software system. 
Specific data structures are essential ingredients of many efficient algo- 
rithms, and make possible the management of huge amounts of data, such 
as large databases and Internet indexing services. Some formal design 
methods and programming languages emphasize data structures, rather 
than algorithms, as the key organizing factor in software design. 


Arrays are used to store a large set of data and manipulate them but the 
disadvantage is that all the elements stored in an array are of the same data 
type. If we need to use a collection of different data type items it is not pos- 
sible using an array. When we require using a collection of different data 
items of different data types we can use a structure. Structure is a method 
of packing data of different types. A structure is a convenient method of 
handling a group of related data items of different data types. 


structure definition: 
general format: 
struct tag_name 

{ 

data type memberl; 
data type member2; 


} Example: struct books 

{ 

char title [30]; char author [25]; int page; 

float price; 

}F 
The keyword struct declares a structure to hold the details of four fields 
namely title, author, pages, and price. These are members of the structures. 
Each member may belong to different or same data type. The tag name can 
be used to define objects that have the tag names structure. The structure 
we just declared is not a variable by itself but a template for the structure. 


We can declare structure variables using the tag name any where in the 
program. For example the statement, 

struct lib books book1,book2,book3; 
declares book1,book2,book3 as variables of type struct lib_books each dec- 
laration has four elements of the structure lib_books. The complete struc- 
ture declaration might look like this 


struct lib books 
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{ 
char title [20]; 
char author [15]; 

int pages; 

float price; 

}e 

struct lib books bookl, book2, book3; 
Structures do not occupy any memory until it is associated with the struc- 
ture variable such as book1; the template is terminated with a semicolon. 
While the entire declaration is considered as a statement, each member is 
declared independent for its name and type in a separate statement inside 
the template. The tag name such as lib_books can be used to declare struc- 
ture variables of its data type later in the program. 


We can also combine both template declaration and variables declara- 
tion in one statement, the declaration 


struct lib books 


{ 

char title [20]; char author [15]; int pages; 

float price; 

} bookl, book2,book3; 

is valid. The use of tag name is optional for example struct 


{ 


} 

bookl, book2, book3 declares bookl,book2,book3 as structure vari- 
ables representing three books but does not include a tag name for use in 
the declaration. 


A structure is usually defineds before the main along with macro defini- 
tions. In such cases the structure assumes global status and all the functions 
can access the structure. 


Union. Unions like structure contain members whose individual data types 
may differ from one another. However the members that compose a union 
all share the same storage area within the computer’s memory where as 
each member within a structure is assigned its own unique storage area. 
Thus unions are used to observe memory. They are useful for application, 
involving multiple members. Values need not be assigned to all the mem- 
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bers at any one time. Like structures, union can be declared using the key- 
word union as follows: 


union item 

{ 

int m; float p; char c; 
} 

code; 

PROGRAMS OF STANDARD METHODS IN “C” LANGUAGI 


Fl 


14.3 Bisection Method (Section 2.7) 


Flow-chart 


y 
[ Define function f(x) | 


Define function bisect 


‘Get the values of 
a, b, aerr, maxitr 


¥ 


Initialize itr 


y 
| Call function bisect 


with x, a, b, itr 


Call function Bisect 


with x1, a, b, itr 


x=xl 
: res (0) x = (a+ b)/2.0 
y 


Print‘solution itr =itr+1 
does not converge —_—_——— 


/ Print itr, x1 y 


Print itr, x1 
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NOTES: a, b are the limits in which the root lies 

aerr is the allowed error 

itr is a counter which keeps track of the number of iterations performed 
maxitr is the maximum number of iterations to be performed 

x is the value of root at the nth iteration 

x1 is the value of root at (n + 1)th iteration. 

Function Bisect: 

Purpose: Performs and prints the result of one iteration 

Variables: x is the result of the current iteration. 


Program 


/* Bisection Method */ 
#include <stdio.h> 
#include <math.h> 
float f(float x) 
{ 
return (x*x*x - 4*x - 9); 
} 
void bisect(float *x,float a,float b,int *itr) 
{ 
*x = (a + b)/2; 
4+ (FL 08); 
printf ("Iteration no. %3d X = %7.5f\n",*itr,*x) ; 
} 
main () 
{ 
int itr = 0, maxitr; 
float x, a, b, aerr, xl; 


printf("Enter the values of a,b," 
"allowed error, maximum iterations\n"); 
Q. 


scanf ("% s£ SE Sd",&a, &b, &aerr, &maxitr); 
bisect (&&,a,b,&itr); 


else 
a= xX; 
bisect (&xl,a,b,&itr); 
if (fabs(xl-x) < aerr) 
{ 
printf ("After %d iterations, root <169> 
"= $6.4f\n",itr,xl); 
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return 0; 


x = xl; 

} while (itr < maxitr); 

printf("Solution does not converge," 
"iterations not sufficient"); 
return 1; 


} 
Computer Solution of Example 2.15 (a) 


Enter the values of a, b, allowed error, maximum iterations 


3 2.0001 20 

Iteration No. 1 X = 2.50000 
Iteration No. 2 X = 2.75000 
Iteration No. 3 X = 2.62500 
Iteration No. 4 X = 2.68750 
Iteration No. 5 X = 2.71875 
Iteration No. 6 X = 2.70313 
Iteration No. 7 X = 2.71094 
Iteration No. 8 X = 2.70703 
Iteration No. 9 X = 2.70508 
Iteration No. 10 X = 2.70605 
Iteration No. 11 X = 2.70654 
Iteration No. 12 X = 2.70630 
Iteration No. 13 X = 2.70642 
Iteration No. 14 X = 2.70648 
After 14 iterations, root = 2.7065 


14.4 Regula-Falsi Method (Section 2.8) 


Flow-chart 


NOTES: f(x) = 0 is the equation whose root is to be found 
x0, x1 are units in which root lies 

aerr is allowed error 

maxitr is maximum number of iterations to be performed 
itr is a counter which keeps track of the number of iterations performed 
x2 is value of root at nth iteration 

x3 is value of root at (n + 1)th iteration 

Function Regula: 

Purpose: Performs and prints the results of one iteration. 
Variables: x is value of root at nth iteration 

fx0, fx are values of f(x) at x0 and «1, respectively. 
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hd 
Define function f(x) 


hd 
Define function regula | 


Get the va 


x0, x1, aerr, maxitr 


ues of 


id 


Initialize itr 


Y 


Callfunction Regula 
with x2, x0, x1, f(x0), f(x1), itr 


Yes No 


x0=x2 


Call function Regula () 
with x3, xO ,x1, f(x0), f((x1), itr 


¥ 


x=x0—-((x1-x0)/ 


(fx1-fx0)) °£x0 


z 
No Print itr, x 


Is 
fabs (x3-x2) 
<aerr? 


itr<maxitr: 
20 


y 
Print ‘Solution as Printsolution 
not converge 


Program 


/* Regula Falsi Method */ 
#include <stdio.h> 
#include <math.h> 

float f(float x) 
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{ 
return cos (x)-x*exp (x); 
} 
void regula (float *x, float x0, float x1, 
float f£x0, float fxl, int *itr) 
{ 
kx = x0-((x1-x0) / (£x1-f£x0) ) *£x0; 
+4 (FLEE) 7 
printf ("Iteration no. 33d X = %7.5f\n", 
kitr,*x); 
} 
main () 
{ 
int itr=0, maxitr; 
float x0,x1l,x2,x3,aerr; 


printf("Enter the values for x0,x1," 
"allowed error,maximum iterations\n*); 

scanf ("Sf %S£ S£ %d",&x0,&x1,&aerr, &Maxitr); 

regula (&x2,x0,x1,f(x0),f£(x1),&itr); 

do 


{ 
if (£(x0)*f(x2) < 0) 


xl = x23 
else 
x0 = x2; 


regula (&x3,x0,x1l,f(x0),f£(x1),&itr); 
if (fabs (x3-x2) < aerr) 
{ 
printf ("After Sd iterations," 
"root = 36.4£\n"; ttxr;x«3); 
return 0; 
} 
X2=x3; 
} while(itr < maxitr); 
printf ("Solution does not converge," 
"iterations not sufficient\n"); 
return 1; 


} 
Computer Solution of Example 2.20 


0 1.0001 20 


Enter the values for x0, xl, allowed error, maximum 


iterations 


Zz 


teration 
teration N 
teration N 


Zz 


teration 


Zz 


teration 


Zz 


teration 


Zz 


teration 


Zz 


teration 


HHH HAHAHAHA a 


After 9 iterations, 


oo OO OO 0 6 


teration No. 


OarAnan oF WN FP 


9 


x Mw MM KM MK 


X 
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.31467 
-44673 
- 49402 
-50995 
-51520 
-91692 
-51748 
SL TO? 
-51773 
root = 0.5177 


ooo & © oa ©@ © © 


14.5 Newton Raphson Method (Section 2.11) 


Flow-chart 


y 
Define function f(x) 


y 
Define function df(x) 


Get the values of 
xO, aerr, maxitr 


y 


Loop for it r = 1 to maxitr 


B 
h = f(x0)/df(x0) 
xl=x0-h 


End Loop (itr) 


Print ‘Solution 
does not converge’. 
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NOTES: F(x) = 0 is the equation whose root is to be found 

df(x) is the derivatives of f(x) w.r.t. x 

x0 is value of root of nth iteration 

x1 is value of root of (n + 1)th iteration 

aerr is allowed error 

maxitr is maximum number of iterations to be performed 

itr is a counter which keeps track of the number of iterations performed. 


Program 


/* Newton Raphson Method */ 
#include <stdio.h> 
#include <math.h> 
float f(float x) 
{ 
return x*logl10(x)-1.2; 
} 
float df(float x) 
{ 
return logl0(x) + 0.43429; 
} 
main () 
{ 
int itr,maxitr; 
float h,x0,x1l,aerr; 


printf ("Enter x0,allowed error," 
"maximum iterations\n"); 
scanf("S£ %£ %d",&x0, &aerr, &Maxitr); 
for (itr=1;itr<=maxitr;itrt+t) 
{ 
h = £ (x0) /df (x0); 
xl = x0-h; 
printf("Iteration no. %3d," 
"x = $9.6f\n",itr,xl1); 
if (fabs(h) < aerr) 
{ 
printf ("After %3d iterations," 
"root = %8.6f\n", itr,xl); 
return 0; 


printf("Iterations not sufficient," 


Numerical MetHops UsiNG C LANGUAGE * 681 


"solution does not converge\n"); 
return 1; 


} 
Computer Solution of Example 2.32 


Enter x0, allowed error, maximum iterations 
2.000001 10 


Iteration No. 1 X = 2.813170 
Iteration No. 2X = 2.741109 
Iteration No. 3 X = 2.740646 
Iteration No. 4 X = 2.740646 
After 4 iterations, root = 2.740646 


14.6 Muller’s Method (Section 2.13) 


Flow-chart 


Define function y(x) 
Get initial approxi- 
mations in array x, 


Get values of 
aerr, maxitr 
Loop for itr = 1 to maxitr 


Calculate li, di, mu, s 


<im<0> Yes ty = (2*y(x{i)*aiy(— mu + s) 
No 


1 = (2*y(x[I])*di)/(— mu — s) 


FE 


x[1 +1] = x(I] + 1*(x{] — x{1 - 1) 


Is 
fabs (x[I + 1] —x| 
<aerr ? 


es 


i) > 


Loop for i=I-—2 to 2 
xfi] =xfi+ 1] 
t 
End Loop (i) 
y ' 


End Loop (itr) Print 


Print ‘Solution 
does not converge’. 
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NOTES: y(x) = 0 is the equation whose root is to be found 

x is an array which holds the three approximations to the root and the new 
improved value 

I is defined as 2 in the program. This has been done because in C, array sub- 
scripts always start from zero and cannot be negative. Use of I facilitates more 
readable expressions. For e.g., x[0] can be written as 

x[{I — 2] which looks more close to x, , it actually represents. 

liis dA, 

di is 6, 

mu is LL, 

sis V[u? — 4yid Aly, Ai —y,_, Oi + y,)] 

lisA 


Program 


/* Muller's Method */ 
#include <stdio.h> 
#include <math.h> 
#define I 2 
float y(float x) 
{ 
return cos (x)-x*exp (x); 
} 
main () 
{ 
int i,itr,maxitr; 
float x[4],li,di,mu,s,l,aerr; 
printf ("Enter the initial <169> 
"approximations\n") ; 
for (i = 1-2;i1<3;i++) 
scant ("Sf£",&x[i]); 
printf ("Enter allowed error," 


"maximum iterations\n"); 
scanf("%S£ %d", &aerr, &maxitr); 


for(itr = lpitr <= maxitrertrtt+) 

{ 
li = (x[I]-x[I-1])/(x[I-1]-x[1I-2]); 
di = (x[I]-x[1-2])/(x[I-1]-x[1I-2]); 


mu = y(x[I-2])*li*li 
- y(x[I-1]) *di*di 
+ y(x[I])*(ditli); 
s = sqrt((mu*mu - 4*y(x[I]) *di*li 
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* (y (&[1=2)])*la-y (x [f=1)) 
*di + y(x[I])))); 


1 = (2*y(x[I])*di)/(-muts) ; 


1 = (2*y(x{[I])*di)/(-mu-s); 
x[I+1l] = x[IT]4+l*(e[I] = x[T=1]); 
printf("Iteration no. % 3d," 

"x = $7.5f\n",itr,x[It+1]); 


if (fabs(x[I+1]-x[I]) < aerr) 


printf ("After %3d iterations," 
"the solution is %6.4f\n", 
PB SP LEL |) y 
return 0; 
} 
for (i=1-2;1<3;i++) 
x[i] = x[itl]; 
} 
printf("Iterations not sufficient," 
"solution does not converge\n") ; 
return 1; 


} 
Computer Solution of Example 2.34 


Enter the initial approximations 

-1 01 

Enter allowed error, maximum iterations 
-0001 10 

Iteration No. 1 XK = 0.44152 

Iteration No. 2 KX = 0.51255 

Iteration No. 3 XK = 0.51769 

Iteration No. 4 XK = 0.51776 


After 4 iterations, the solution is 0.5178 
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14.7. Multiplication of Matrices [Section 3.2 (3)4] 


Flow-chart 


y 
Define function matmul 


x 
Get values of 1, 
m, p,q 


Call function (™) 
matmul with a, 


b,c, 1, m, p,q 


Print “The two 
matrices can not 
be multiplied” 


Get elements of 
first matrix 
into array a 


Get elements of 
second matrix 
into array b 


y 


Loopfo ri=0tol 


i. 


Loop for j = 0 to q—1 


¥ 


s=0 


x 


Loop for k=0 to m — 1 


he 


st=a_— [i][k]*b[k]fj] 


bd 
End Loop(k) 
1 
clilljJ=s 
I 
End Loop(j) 


y 
End Loop(i) 


/ Print Solution : 
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NOTES: MAX is largest number of rows or columns any matrix can have. 
(If MAX. = 20, 11 x 20 and 20 

x 13 matrices can be multiplied but 1 x 21, 22 x 1 matrices cannot be 
multiplied until MAX > = 22 

A, B are arrays which contain the matrices to be multiplied 

C is array which contains the result of multiplication 

L, M are respectively the rows, columns of first matrix 

P, Q are respectively the rows, columns of second matrix 

Function getelems 

Purpose: To input am x n matrix 

Function Matmul. 

Purpose: It performs the multiplication of matrices after taking them 
from the user and prints the result. 

Variables: i, j, k are loop control variables. 


Program 


/* Multiplication of matrices */ 
#include <stdio.h> 
#define MAX 20 
typedef float matrix [MAX] [MAX]; 
void getelems(matrix x,int m,int n) 
{ 

LO. Day hh 

for (i=0; i<m;it++) 

for (j=0; j<n; j++) 
scanf("Sf",&x[iJ[j]); 

} 
void printsol(matrix x,int m,int n) 
{ 


Int by 7 


for (i=O;i<m;it+ 


{ 


for (j=0;3<n;j++) 
printf ("%5.1£",x[i][j]); 

printf ("\n"); 

} 

} 
void matmul (matrix a,matrix b,matrix c, 

int 1, int m,int p, int q) 

{ 

float s; 

int 1577 
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printf ("Enter the elements of the" 
"first matrix\n"); 

getelems(a,1,m); 

printf ("Enter the elements of the" 


"second matrix\n") ; 
getelems (b,p,q); 
for (i=0;1i<1;it++) 
for (j3=0;4<q;j++) 
{ 
s = 0; 
for (k=0;k<m; k++) 
s += ali] [k] *b(k] [5]; 
cfil(j] = si 
} 
printf ("The solution is \n"); 
printsol(c,1l,q); 
} 
main () 
{ 
matrix a,b,c; 
int 1,m,p,q; 
printf("Enter the row, coloumn of the" 
"first matrix\n"); 
scanf ("Sd %d",&1, &m) ; 
printf("Enter the row, coloumn of the" 


"second matrix\n"); 
scanf ("Sd Sd", &p, &q) ; 
if (m!=p) 
printf("The two matrices cannot" 
"be multiplied\n") ; 
else 
matmul(a,b,c,1,m,p,q); 


} 
Computer Solution of Example 3.7 


Enter the row, column of the first matrix 
33 
Enter the row, column of the second matrix 


3 2 
Enter the elements of the first matrix 


012 
12 3 
234 
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Enter the elements of the second matrix 


1 -2 
-1 0 
2 -1 
The solution is 
S00 S20 
SOs. =5:.-0 
70° =8.0 


14.8 Gauss Elimination Method [Section 3.4(3)] 


Flow-chart 


x 
Get the Augmented 
Matrix in Array a 


= 
Loop for j = 0 to N-2 
1 
Loop fori =j+1to N-1 


¥ 


ValilUi] 


t=alil [ 


Loop for k = 0 to N 


al =a fil kt 


+ 
End Loop (k) 


ad 
End Loop (i) 
q 
End Loop (j) 


Print upper 
triangt ilar matrix 


y 
Loop fori=N-—I1to0 Step-1 


ad 
s=0 
1 
Loop for j =i+ 1toN 


y 


s + = afi] [j]* xij] 


bd 
End Loop (j) 


xli}=(aliJ[N]-s)/alil li] 


V 
End Loop (i) 


¥ 
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NOTES: N is the number of unknowns 

a is an array which holds the Augmented Matrix 

x is an array which will contain values of unknowns 
i, j, k are loop control variables. 


Program 


/* Gauss elimination method */ 
#include <stdio.h> 
#define N 4 main() 
{ 
float a[N] [N+1],x[N],t,s; 
int i,j,k; 
printf ("Enter the elements of the" 
"augmented matrix rowwise\n"); 
for (i=0;i<N;it+) 
for (j3=0;j3<N+1;3++) 
scanf("Sf",é&a[i][j]); 
for (j=0;j<N-1;j++) 
for (i=j+1;i<N;itt+) 


t = alil(jl/aljllil; 
for (k=0;k<N+1; k++) 
a[i] [k]=a[j] [k] *t; 


} 


/* now printing the 


upper triangular matrix */ 

printf ("The upper triangular matrix" 
"TS3e\n") 7 

for (i=0;i<N;itt+ 


{ 
for (j=0;j<N+1; ++) 
printf ("%8.4f",a[lil[j]); 

printf("\n"); 
} 
/* now performing back substitution */ 
for (i=N-1;i>=0;i- -) 
{ 

s = 0; 

for (j=i+1;3<N;j++) 

s += afil(j]*x (jl; 

x[i] = (alil [N]-s)/alil] fil; 

} 


/* now printing the results */ 
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printf ("The solution is:- \n"); 
for (i=0;i<N; i++) 

printf ("x[%3d] = %$7.4f\n",itl,x[i]); 
} 


Computer Solution of Example 3.19 


Enter the elements of augmented matrix rowwise 


10 -7 3 5 6 

=6 8 = -4 5 

3 L 4 11 2 

5 29 =2 4 7 
10.000 -7.0000 3.0000 5.0000 6.0000 
0.0000 3.8000 0.8000 -1.0000 8.6000 
-0.0000 -0.0000 2.4474 10.3158 -6.8158 
0.0000 -0.0000 -0.0000 9.9247 9.9247 


The solution is:- 
X[ 1] = 5.0000 


X[ 2] = 4.0000 
X[ 3] = -7.0000 
X[ 4] = 1.0000 


14.9 Gauss-Jordan Method [Section 3.4(4)] 


Flow-chart 


Get the Augmented 
Matrix in Array A 


Loop forj =0toN-1 


Loop fori = 0 toN-1 


t = ali] [jJ/alj] Gi] 


Loop for k = 0 toN 


aliJ[k] — = alj][k] *t 


End Loop (k) 


End Loop (i) 


End Loop (j) 


Print diagonal matrix 
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Notes: a is an array which holds the Augmented Matrix 

N is the numbrt of unknowns. e.g. if it is a 3 x 3 system of equations, 
N = 3, and if x 5 system take N = 5. 

i, j, k are loop variables. 


Program 


/* Gauss jordan method */ 
#include <stdio.h> 
#define N 3 main() 
{ 
float a[N] [N+1],t; 
Int. Lyf, KF 
printf ("Enter the elements of the " 
"augmented matrix rowwise\n") ; 
for (i=0;i<N;it+) 
for (j3=0;3<N+1;3++) 
scanf ("S£", éa[i][j]); 
/* now calculating the values of x1,x2,....,xN */ 
for (j=0;3<N;j++) 
for (i=0;i<N;i++) 
if (i!=3) 
{ 


t = alil(jl/aljltil; 
for (k=0;k<N+1;k++) 
ali] ([k] -= alj] ([k]*t; 
} 
/* now printing the diagonal matrix */ 
printf ("The diagonal matrix is:-\n"); 
for (i=0;i<N;i+t+) 
{ 


for (j3=0;j3<N+1;j3++) 
printf ("%9.4£",a[i][j]); 
printf ("\n"); 
} 


/* now printing the results */ 


printf ("The solution is:- \n"); 
for (i=0;i<N;it+) 
printf ("x[%3d] = %7.4f\n", 


it+l,a[il([N]/a[il[il); 
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Computer Solution of Example 3.22 


Enter elements of augmented matrix rowwise 
10 -7 3 5 6 
-6 8 -1 -4 5 
3 al 4 11 2 
5 =9 -2 4 7 
The diagonal matrix is:- 
10.0000 -0.0000 -0.0000 -0.0000 50.0000 
0.0000 3.8000 -0.0000 0.0000 15.2000 
-0.0000 0.0000 2.4474 0.0000 =17.1316 
0.0000 -0.0000 0.0000 9.9247 9.9247 
The solution is:- 
X[ 1] = 5.0000 
X[ 2] = 4.0000 
X[ 3] = -7.0000 
X[ 4] = 1.0000 


14.10 Factorization Method [Section 3.4(5)] 


Flow-chart 


Get the elements of 
Augmented Matrix 
into Arrays a and b 


¥ 


Calculate elements of 1 & u 


¥ 


Print elements of | & u 


Find v by solving lv=b 
by forward substitution 


Find x by solving ux = v 
by backward substitution 


¥ 


/ Print Array x as solution 7 
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cil 
NOTES: Uy = ay — > Uglix, 
k=l 
= 


v 
Ly =| ay — Dy tule wy 
=i 
N is the number of unknowns 
I is the lower triangular matrix u is the upper triangular matrix a is the 
coefficient matrix 
b is the constant matrix (Column matrix) 
v is a matrix such that lv = b 
x will contain the values of unknowns 
i, j, m are loop control variables 
Function urow (1) 
Purpose: Calculates elements of ith row of u 
Variables: m is the number of unknowns 
j, k are loop control variables 
Function Lcol (J) 
Purpose: Calculates elements of jth column of | 
Variables: m is the number of unknowns 
i, k are loop control variables. 
Function Printmat 
Purpose: To print an N x N matrix. 


Program 


/* Crout triangularization method */ 
#include <stdio.h> 
#define N 4 
typedef float matrix[N] [N]; 
matrix 1,u,a; 
float b[N],x[N],v[N]; 
void urow(int i) 
{ 
float s; 
int j,k; 
for (j=1;3<N; j++) 
{ 
s = 0; 
for (k=0;k<N-1; k++) 
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s t= ulk] [j]*1[i] [k]; 
ufil(j3] = ali] [j]-s; 


} 
void lcol(int j) 
{ 
float s; 
int i,k; 
for (i=j+1;1i<N;i++) 
{ 
s = 0; 
for (k=0;k<=j-1;k++) 
s += ul[k] [3] *1[il] [kl]; 
1fil(3] = (alil(jl-s)/ulj1[31; 


} 
void printmat (matrix x) 
{ 
EME. 1 7 
for (i=0;i<N;1i++) 
{ 
for (j3=0;3<N; j++) 
printf ("%8.4f£",x[i]l[j]); 
printf("\n"); 
} 
} 
main () 
{ 
int i,j3,m; 
float s; 
printf("Enter the elements of augmented" 


"matrix rowwise\n"); 
for (i=0;i<N;it+t+) 
{ 
for (j3=0;3<N; j++) 
scanf("Sf",é&ali][j]); 
scanf("S£",&b[i]); 
} 
/* now calculating the elements of 
1 andu */ 
for (i=0;i<N;1i++) 
L[i] [iy] = 2.0; 
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for (m=0;m<N;m++) 
{ 
urow (m) ; 
if (m < N-1) lcol(m); 


/* now printing the elements of 1 and u */ 
printf ("\t\tU\n"); printmat (u); 

printf ("\t\thL\n"); printmat (1); 

/* now solving LV=B 

by forward substitution */ 

for (i=0;i<N; i++) 


{ 


s = 0; 
for (j=0;3<=1i-1; ++) 
s += 1[il(j]*vljle 
v[i]l = b[il-s; 
} 
/* now solving UX=V 
by backward substitution */ 
for (i=N-1;i>=0;i ) 
{ 


s = 0; 
for (j=i+1;3<N;j++) 
s += ulil(j]*x(jl; 
x[i]l = (v[il-s)/ulil (il; 
} 
/* printing the results */ 
printf ("The solution is:-\n"); 
for (i=0;i<N;i+t+) 
printf ("x[%3d] = %6.4f\n",it1,x[i]); 
} 


Computer Solution of Example 3.23 


Enter the elements of augmented matrix rowwise 


3 2 7 4 
2 3 1 5 
) 4 i: 7 
U 
3.0000 2.0000 7.0000 
0.0000 1.6667 -3.6667 
0.0000 0.0000 -1.6000 
L 
1.0000 0.0000 0.0000 
0.6667 1.0000 0.0000 


1.0000 1.2000 1.0000 
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The solution is: 
x[1] = 0.8750 
x[2] 131250 
x[3] = -.1250 


Computer Solution of Example 3.24 


Enter the elements of augmented matrix rowwise 


10 -7 3 5 6 
-6 8 -l1 -4 5 
3 1 4 11 2 
5 -9  =2 4 7 
U 
10.0000 -7.0000 3.0000 5.0000 
0.0000 3.8000 0.8000 -1.0000 
0.0000 0.0000 2.4474 10.3158 
0.0000 0.0000 0.0000 9.9247 
L 
1.0000 0.0000 0.0000 0.0000 
- 0.6000 1.0000 0.0000 0.0000 
0.3000 0.8158 1.0000 0.0000 
0.5000 -1.4474 -0.9570 1.0000 
The solution is:- 
x[ 1] = 5.0000 
x[ 2] = 4.0000 
x[ 3] = -7.0000 
x[ 4] = 1.0000 
14.11 _Gauss-Seidal Iteration Method [Section 3.5(2)] 
Flow-chart 


Notes: N is the number of unknowns 

a is an array which holds the augmented matrix 

x is an array which will hold the values of unknowns 

aerr is allowed error 

maxitr is the maximum number of iterations to be performed 

itr is the counter which keeps track of number of iterations performed 
err is error in value of x, 


maxerr is maximum error in any value of x, after an iteration. 


Program 


/* Gauss Seidal method */ 
#include <stdio.h> 
#include <math.h> 
#define N 4 main() 
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y 


Initialize x to 0 


¥ 
Get the elements of 
Augmented Matrix 
in Array a 


Get the values 
of aerr, maxitr 


i 3 
/ Print Heading / 
Loop for itr = 1 to maxitr 
A 


Maxerr = 0 


¥ 


Loop fori=0toN-1 


Loop for} =O toN-1 


Isj!=i? +} s+=alil[] *xfi] 


End Loop (j) 


t = (afJ[N] — s)/ali] [i] 


¥ 


err = fabs (x[i] — t) 


maxerr = err 


@ 


y 


| Bud Loop ti) | 


Print Results 


/ of Iteration 


No 


¥ 


maxerr < aerr 


Print Solution 


End Loop (itr 


) | 


y 


¥ 


Print Solution 
No < J does not converge 
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float a[N] [N+1],x[N],aerr,maxerr, t,s,err; 


int i,j,itr,maxitr; 


/* 


for 


first initializing the array x */ 
(i1=0;i<N;it+t+) x[i]=0; 


printf("Enter the elements of the" 


for 


"augmented matrix rowwise\n"); 
(1=0; i<N; i++) 


for (j3=0;j3<N+1;j3++) 


scanf("S£", &a[i] [4]); 


printf ("Enter the allowed error," 


"maximum iterations\n"); 


scanf ("Sf %d",&aerr, &maxitr); 
printf("Iteration x[1] x[2]" "x[3]\n"); 


for 


{ 


(itr=1;itr<=maxitr;itrtt) 


maxerr = 0; 
for (i1=0;1i<N; i++) 


} 


s = 0; 
for (j3=0;34<N; j++) 

if (j!=1) s += alil[j]*xljl; 
t = (alil([N]-s)/alil lil; 
err = fabs(x[i]-t); 
if (err > maxerr) maxerr = err; 
x[i] = t; 


printf ("S5d",itr); 
for (i=0;i<N; i++) 


printf ("S9.4f",x[il]); 


prantEe ("\n") + 
if (maxerr<aerr) 


{ 


} 


, 


printf("Converges in %3d" 
"iterations\n",itr) 
for (i=0;i<N; i++) 
printf ("x[%3d] = %7.4f\n", 
ay ea] 
return 0; 


printf("Solution does not converge," 
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"iterations not sufficient\n"); 


return 1 


} 


Computer Solution of Example 3.28 


Enter the 


, 


elements of augmented matrix rowwise 


20. “L- 32) 27 
3 20 -1 -18 
2 - 320 25 
Enter the allowed error, 
-0001 10 
Iteration X(1) 
1 0.8500 
2 1.0025 
3 1.0000 
4 1.0000 


maximum iterations 


Converges in 4 iterations 
X[1] = 1.0000 
X[2] = -1.0000 
X[3] = 1.0000 


Computer Solution of Example 3.30 


X(2) 


1.0275 
0.9998 
1.0000 
1.0000 


3 


rPRPOoOFR 


X (3) 

0109 
- 9998 
0000 
- 0000 


Enter the elements of the augmented matrix rowwise 


maximum iterations 


10 =2 =. -1 
= 2 10 = 1 -1 
= 7 =i. 10 -2 
= 1 -1 =2 10 
Enter the allowed error, 
-0001 15 
Iteration x[1] 
1 0.3000 
2 0.8869 
3 0.9836 
4 0.9968 
i) 0.9994 
6 0.9999 
7 1.0000 
Converges in 7 iterations 
x[ 1] = 1.0000 
x[ 2] = 2.0000 
x[ 3] = 3.0000 
x[ 4] = 0.0000 


NPrPRPP PB 


x[2] 


-5600 
9523 
9899 
9982 
19997 
29999 
0000 


WWN NN DN NY 


x3) 

. 8860 
9566 
.9924 
9987 
9998 
0000 
0000 
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14.12 Power Method (Section 4.11) 


Flow-chart 


Ad 
Get the values of 
a, X, aerr, maxitr 


y 


y 
Define Subroutine 
max = fabs (x(1)) 


findmax 


y 
Y 


Call function findmax Loop for i= 1to N-1 
with e, x, n 


Ad 
No 


Loop for itr = 1 to maxitr 


Y Yes 


Calculater = a*x 


Md 


Call function findmax 
: End Loop (i) 
with t, r,n 


, 


norm alizer 


Y 


maxe = 0 


¥ 


Loop for i = 0 to N-1 


err = fabs (x[i] — r[i]) @) 


M 


Yes Print results 
ee of Iteration 


Is 


maxe 


No i 

TH Is 

xi) = xii] (erry < = aerr) 
Y and 


max e < = aerr) 


( 


End Loop (itr) 


Print Solution 


@ does not converge 


| End Loop (i) 


Ad 
errv = fabs (t — e) 
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Notes: N is number of rows (or columns) in square matrix 

a is the square matrix 

x is the eigenvector at nth iteration 

ris the eigenvector at (n + 1)th iteration 

e is the eigenvalue at nth iteration 

t is the eigenvalue at (n + 1)th iteration 

aerr is the allowed error in eigenvalue and eigenvector 
maxitr is the maximum number of iterations to be performed 
err is error in an element of the eigenvector 

maxe is the maximum error in any element of the eigenvector 
errv is error in the eigenvalue 

itr, i, k are loop control variables. 

Function findmax: 


returns it in Max. 


Purpose: Finds the maximum element in array x(a N-element array) and 


Program 
/* Power method for finding largest eigenvalue */ 
#include <stdio.h> 
#include <math.h> 
typedef float array[N]; 


void findmax(float *max,array x) 


{ 


ni gk cmenly 
*max = fabs(x[0]); 
for (i=1;i<N; i++) 
if (fabs(x[i]) > *max) 
*max = fabs(x[i]); 
} 
main () 


{ 
float a[N] [N],x[N],r[N],maxe, 
rr,errv,aerr,e,s,t; 


int i,j,k,itr,maxitr; 


printf ("Enter the matrix rowwise\n"); 
for (i=0;i<N;it+) 
for (j=0;j<N;j++) 
scanf("S£",&ali][j]); 
printf ("Enter the initial approximation" 


"to the eigen vector\n"); 
for (i=0;i<N;itt) 
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scant ("S£",&x[i]); 
printf("Enter the allowed error," 


"maximum iterations\n"); 
scanf("S£ %d",&aerr, &maxitr); 
printf("Itr no. Eigenvalue" 


'EigenVector\n"); 


/* now finding the largest eigenvalue in 
the initial approx. to eigen vector */ 
findmax (&e, x); 


/* now starting the iterations */ 


for (itr=1;itr<=maxitr;itrt+t) 


{ 


/* loop to multiply the matrices 
a and x */ 
for (i=0;i<N;1i++) 
{ 
s = 0; 
(k=0;k<N; k++) 

s += a[i] [k]*x[k]; 

r[i]=s; 


for 


} 

findmax(&t,r); 

for (i=O;i < N;itt+) r[i] /= t; 
maxe = 0; 

for (i=0;i<N; i++) 


{ 


err = fabs(x[i]-r[il); 
if (err > maxe) maxe = err; 
x[i] = rlil; 
} 
errv = fabs (t-e); 
e=t; 


printf ("S4d 312.4f£",itr,e); 
for (i=0;i<N;1i++) 
printf ("$9.3£",x[i]); 
printf("\n"); 
if ((errv <= aerr) && (maxe <= aerr)) 
{ 
printf ("Converges in %d" 
"iterations\n",itr) ; 
printf ("Largest eigen value" 
"= $6.2f\n",e); 
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printf ("Eigenvector:-\n") ; 
for (i=0;i<N; i++) 
printf ("x[%3d] = %6.2f\n", 
aP i: 53a. ]') ¥ 
printf("\n"); return 0; 


} 

printf ("Solution does not converge," 
"iterations not sufficient\n"); 

return 1; 


} 
Computer Solution of Example 4.11 


Enter the matrix rowwise 


2 1 0 

= 2 =1 

O- ei 2 

Enter the initial approximation to the eigenvector 

100 

Enter the allowed error, maximum iterations 

.O1 10 

Itr No. Eigen Value Eigen Vector 

1 2.0000 1.000 - 0.500 0.000 
2 2.5000 1.000 - 0.800 0.200 
3 2.8000 1.000 -1.000 0.429 
4 3.4286 0.875 -1.000 0.542 
5) 3.4167 0.805 -1.000 0.610 
6 3.4146 0.764 -1.000 0.650 
7 3.4143 0.741 -1.000 0.674 
8 3.4142 0.727 -1.000 0.688 
9 3.4142 0.719 -1.000 0.696 

Converges in 9 iterations 

Largest eigenvalue = 3.41 

Eigenvector:- 

X[1] = 0.72 

X[2] = -1.00 


X[3] = 0.70 
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14.13. Method of Least Squares (Section 5.5) 


Flow-chart 


Y 
Initialize all elements 
of augm to zero 


y 


/' Get the value of n / 


Y 
Read in the date points 
and increment appropriate 
elements of augm 


Y 
Assign values to non- 
unique elements of augm 


Print augm 


Y 
Solve for a, b, c by 
Gauss Jordan Method 


y 


Print a, b, 
c as solution 


Notes: augm is the augmented Matrix. 


n is the number of data points. 


Program 


/* Parabolic fit by least squares */ 
#include <stdio.h> 
main () 
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float augm[3] [4]={{0,0,0,0},{0,0,0,0},{0,0,0,0}}; 
float t,a,b,c,x,y,xsq; 
int i, yy ky ne 


puts ("Enter the no. of pairs of" 
"observed values:"); 
scanf("Sd", &n); 
augm[0] [0] = n; 
for (i=0;i<n;it+) 
{ 
printf ("pair no. Sd\n",itl); 
scanf ("Sf S£",&x,&y); 


XSQ = X*xX; 
augm[0O][1] += x; 
augm[0][2] += xsq; 
augm[1][2] += x*xsq; 
augm[2][2] += xsq*xsq; 
augm[0][3] += y; 
augm[1][3] += x*y; 
augm[2][3] += xsq*y; 
} 
augm[1][1] = augm[0] [2]; 
augm[2][1] = augm[1] [2]; 
augm[1][0] = augm[0] [1]; 
augm[2][0] = augm[1] [1]; 
puts ("The augmented matrix is:-"); 


for (i=0;i<3;i+t+) 
{ 
for (j=0;3<4; j++) 
printf ("S9.4f",augm[i] [j]); 
printf ("\n"); 
} 
/* Now solving for a,b,c 
by Gauss Jordan Method */ 
for (43=0;4<3; 3++) 
for (i=0;i<3;i+t+) 
if (i!=3) 
{ 
t = augm[i] [j]/augm[j1] [3]; 
for (k=0;k<4; k++) 
augm[i] [k] 
-= augm[j][k] *t; 
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} 
a = augm[0] [3]/augm[0] [0]; 
b augm[1] [3]/augm[1] [1]; 
][3] 


c = augm[2 /augm[2] [2]; 
printf ("a $8.4f b = %8.4f " 
"Wo = 28 .4£\n";a,b;¢) +? 


} 
Computer Solution of Example 5.7 


Enter the no. of pairs of observed values: 

7 

Pair No. 1 

1.2.1 

Pair No. 2 

1.25°:1.3 

Pair No. 3 

21.6 

Pair No. 4 

2 2 

Pair No. 5 

33027 

Pair No. 6 

3:5: 334 

Pair No. 7 

4.0 4.1 

The augmented matrix is:- 
7.0000 17.5000 50.7500 16.2000 
17.5000 50.7500 161.8750 47.6500 
50.7500 161.8750 548.1875 154.4750 


a = 1.0357 b = -0.1929 c = 0.2429 
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14.14 Method of Group Averages (Section 5.9) 


Flow-chart 


Y 
| Enter number of | 


observations, n 


Y 


Enter different values of t and 
corresponding values of r 


Y 
Fori = 1 to n/2 


tsl = tsl + til 
rsl = rs] + r[i] 


EE 
End Loop (i) 


————————————— 
Fori=n/2+lton 


Y 
ts2 = ts2 + tli] 
rs2 = rs2 + r[i] 


x, = tsl/(n/2) 


Y 
X ; 
y, =rsl/(n/2) y = rs2/(n/2) 


Print values of ‘a’ and ‘b’ 


Program 


#include<conio.h> 
#include<stdio.h> 
void main () 
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{ 

int t[10],n,i,tsl=0,ts2=0; 

float a,b,rsl=0,rs2=0,r[10],x1l,yl,x2,y2; 

clrecrit) + 

printf ("enter the no. of observations\n"); 
scanf("S$d", &n); 

printf ("enter the different values of t\n"); 

for (i=1;i<=n; i++) 

{ 

scanf("%d",&t[i); 

} 

printf("\n enter the corresponding values of r\n"); 
for (i=1;1i<=n;i++) 

{ 

scanf("Sf",é&r[i]); 

} 

for (i=1;i<=(n/2);i++) 

{ tslt+=t[i]; rslt+=r[i]; 

} 
for (i=((n/2)+1);i<=n;it++) 
{ ts2+=t[i]; rs2+=r[i]; 

} 
xl=tsl1/ ( 
yl=rsl1/(n/2 
x2=ts2/(n/2 
y2=rs2/(n/2 
b=(y2-yl1)/ ane 

a=yl-(b*x1); 

printf ("the value of a&b comes out to be\n"); 
printf ("a=%6.3f\nb=%6.3f",a,b); 

getch(); 

} 


Computer Solution of Example 5.16 


Enter the no. of observations 

8 

nter the different values of t 

40 50 60 70 80 90 100 110 

nter the corresponding values of r 

1069.1 1063.6 1058.2 1052.7 1049.3 1041.8 1036.3 1030.8 
the values of a&b come out to be 

a=1090.256 

b=-0.534 
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14.15 Method of Moments (Section 5.11) 


Flow-chart 


Y 
Enter the number of 
observations, n 
Y 


Enter different values of x 
and corresponding values of y 


Fori = 1 ton 


yt = yt + yi] 
xlyt = xlyt + x[i] * yli] 
Y 
End Loop (i) 
Y 
ml =h* yt, m2 =h * xlyt 
Y 
ll = (-(h/2) + x1) 
12 = ((h/2) + x(n)) 
Y 
cl = (12-11) 


c2 = ((12 * 12) — (1 * 11))/2 
c3 = ((12°12*12) — (11 * 1 * 11))/3 


¥. 
d= c2%/cl, dl= d*cl 
d2 = d* c2, ml = d*ml 


Y 
b = (m2 — m1)/(c3 — d2) 
a = (ml — (d2 * b))/d1 


Y 


Print values of ‘a’ and ‘b’ 


Numerical MetHops Usinc C LANGUAGE ¢ 709 


Program 


#include <stdio.h> 

#include <conio.h> 

void main() 

{ 

int x[10],y[10],i,n, yt=0,xlyt=0; 

float a,b,11,12,c1,c2,c3,d,d1,d2,m1,m2,h; 
clrecr() 

printf ("enter the no. of observations\n"); 
scanf("S$d", &n); 

printf ("enter the different values of x"); 
for (i=l;i<n;it+) 
{ 

scanf ("%d",&x[i 
} 


printf ("\nenter the corresponding values of y\n"); 


~ 


for (i=1l;i<n;i+t+) 
{ 

scanf ("Sd",é&y[i 
} 

h=x[2]-x[1]; 
for (1i=1;i<=n;i+t+) 
{ ytt=y[i]; xlytt=x[i]*y[il; 
} ml=h*yt; m2=h*xlyt; 


~ 


11=(-(h/2)+x[1]); 
12=((h/2)+x[n]); 
cl=(12-11); 


c2=((12*12)-(11*11))/2; 

c3=((12*12*12) -(11*11*11) ) /3; 

printf ("The observed equations are\n"); 

printf ("%5.2fat%5.2fb=%5.2f\nS5.2fat5.2fb=%5.2f", 
cl,e2, ml, ¢2,c3:,m2) ; 

d=c2/cl; 

dl=d*cl; 

d2=d*c2; 

ml=d*m1; 

b=(m2-m1) / (c3-d2) ; 

a=(m1-(d2*b) )/dl; 

printf("\nOn solving these equations 
we get a=%5.2f&b=%5.2f\n",a,b); 

printf ("hence the required equation is y=%5.2f+%5.2f£x",a,b); 
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getch (); 
} 


Computer Solution of Example 5.20 


Enter the no. of observations 


4 

nter the different values of x 
1234 

nter the corresponding values of y 
16 19 23 26 


the observed equations are 

4.00a+10.00b=84.00 

10.00a+30 .33b=227.00 

on solving these equations we get a = 13.03&b=3.19 
hence the required equation is y=13.03+3.19x 
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14.16 Newton’s Forward Interpolation Formula (Section 7.2) 


Y 
i Get the value of n 7 
Y 
/ Get elements ; 
f ax, a 
of ax, ay i 
: Y 
Get value of x i i=i-l | 
Y Y 
h = ax [1] —ax(0] p = (x—ax[i])/h | 
Y ar 
Fori=0Oton-1 yp = aylil | 
Y¥ Y 
diff [i][1] = ay [i + 1] - ay[il For k = 1 to ORDER 
Y 
End Loop (i) nr*=p-k+1 
Y Y 
Loop for j = : to ORDER dr*=k 
Loop fori = 0 ton-j Y 
Y yp + = (nr/dr)* diff [i][k 
diff {i][j] = diff [i + 1] i 
j= 1)— diff fj - End Loop (k) 
" p 
End Loop (i) Y 
Y Print x, y, p as solution 
End Loop (j) Y 
t stop > 
i=0 
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NOTES: MAXN is the maximum value of N 

ORDER is the maximum order in the difference table 
ax is an array containing values of x (x), X,,...-..5 %,) 
ay is an array containing values of y(y,, y,,..---5 Y,) 
diff is a 2D Array containing the difference table 
h is spacing between values of X 

x is value of x at which value of y is wanted 

yp is calculated value of Y 

nr is numerator of the terms in expansion of y, 
dr is denominator of the terms in expansion of y, 


Program 


/* Newton's forward interpolation */ 

#include <stdio.h> 

#define MAXN 100 

#define ORDER 4 main() 

{ 

float ax[MAXN+1],ay[MAXN+1], 
diff [MAXN+1] [ORDER+1], 
nr=1.0,dr=1.0,x,p,h,yp; 


Int: Ny, Ly, 7, kF 
printf ("Enter the value of n\n"); 
scant ("Sd", én); 
printf ("Enter the values in form x,y\n"); 
for (i=0;i<=n;1i++) 

scanf(" 


oe 


Sf", &ax[i],&ayli]); 


printf ("Enter the values of x" 


"for which value of y is wanted \n"); 
Scant ("Sf", &x)¥ 
h=ax[1]-ax[0]; 
/* now making the diff. table */ 
/* calculating the lst order differences */ 
for (i=0;i<=n-1;i++) 
diff[il][l] = ayliti]-aylil; 
/* calculating the second & 


higher order differences.*/ 
for (j=2;3<=ORDER; j++) 
for (i=0;i<=n-j;i++) 
diff [i] [5] = diff[itl] [5-1] 
-difflil[j-ll; 
/* now finding x0 */ 
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1-0; 

while (!(ax[i] > x)) itt; 

/* now ax[i] is x0 & ay[i] is yO */ 
i=; 

p = (x-ax[i])/h; yp=ay[i]; 

/* Now carrying out interpolation */ 
for (k=1;k<=ORDER; k++) 

{ 


nr *= p-kt+l; dr *=k; 
yp t= (nr/dr)*diff [i] [k]; 
} 
printf ("when x = %6.1f, y = %6.2f\n" 
1X&,YP)i 
} 


Computer Solution of Example 7.1 


Enter the value of n 

6 

Enter the values in form x, y 
100 10.63 

150 135:03 

200 15.04 

250 16.81 

300 18.42 

200 19.90 

400 21.27 


Enter the values of x for which value of y is wanted 
218 
When x = 218.0, y = 15.70 
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14.17 _Lagrange’s Interpolation Formula (Section 7.12) 


Flow-chart 


Y 


Get the value of n 


Get elements 
of ax,ay 


Y 


/ Get the value of x 7 


y=0 


Y 
Loop for i = 0 ton 


Y 


nr = dr = 1 


Loop for J = 0 toN 
y 


Yes 
nr*= x — ax[j] 


Y 


dr*= ax{i] — ax[j] 


End Loop (j) 


Y 


y+=(nr/dr)*ayli] 


End Loop (i) 


Print x, y 
as solution 
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NOTES: MAX is the maximum value of n 

ax is an array containing values of x(x, x,,...-. 1) 
ay is an array containing values of y(y,, y,,...... yn) 
x is the value of x at which value of y is wanted 

y is the calculated value of y 

nr is numerator of the terms in expansion of y 

dr is denominator of the terms in expansion of y. 


Program 


/*Lagrange's Interpolation*/ 
#include <stdio.h> 
#define MAX 100 
main () 
{ 
float ax [MAX+1],ay[MAX+1],nr,dr,x, y=0; 
5 0 ane Bes or er 
printf ("Enter the value of n\n"); 
scant ("Sd", én) ; 


printf ("Enter the set of values\n"); 
for (i1=0;i<=n;i++) 
scanf ("Sf%f",éax[i],éayli]); 


puts("Enter the value of x for which" 
"value of y is wanted"); 
scanf ("S£", &x) ; 
for (i=0;i<=n;i++) 
f 
nr=dr=1; 
for (j=0;j<=n; j++) 
if (j!=i) 
{ 


nr *= x-ax[j]; 


dr *= ax[i]-ax[jl]; 
} 
y += (nr/dr)*aylil; 
} 
printf ("When x=%4.1f y=%7.1f\n",x,y); 
} 


Computer Solution of Example 7.17 


Enter the value of n 
4 
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Enter the set of values 


5 150 
7 392 
11 1452 
13 2366 
17 5202 
Enter the value of x for which value of y is wanted 
9 


When x = 9.0 y = 810.0 


14.18 _Newton’s Divided Difference Formula (Section 7.14) 


Flow-chart 


Enter number of 
observations,n 


Y 


Enter diff. values of x 
and corresponding values of y 
f =y[1] 
hel 


Y 


Entervalue of ‘k in f(k) 
Y 
Fori=lton—-1 
y 
pli] = ((yli + 1] — yl Asli + j] — xfil)) 
yli] =plil 


¥ 
End Loop (i) 


x 
For i = | toj 


i 
f= fi *(k—sfi)) 


—— 
End Loop (i) 


h= f+ ylll*f 


fis l;nen-1;j=j+1] 


Print ‘f’ 
es 
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Program 


#include<stdio.h> 

#include<conio.h> 

void main() 

{ 

int x[10], y[10], p[10]; 

int k,f,n,i,j=1,f1=1,f2=0; 

clrecr() * 

printf ("enter the no. of observations\n"); 
scanf("S$d", &n); 

printf ("enter the different values of x\n"); 
for (i=1;i=<n; i++) 

{ 
scanf(''Sd'',&x[i]); 


} 


printf ("enter the corresponding values of y\n"); 


for (i=1; i<=n;i++) 
{ 

scanf ("Sd",&y[i 
} 

f=-y[1]; 
printf ("enter the value of 'k' in f(k) you want to evaluate\n"); 
scanf ("Sd",&k); 

do 

{ 


~ 


(i=1;i<=n-1;i++) 


mu) 
e) 
KR 


((y[itl]-yli])/ (x[itj)]-x[il)); 
ijJ=plil; 


— ha Hh hw KO Se 
ll 
fs 


n-7-; 

jtt; 

} while(n!=1); 
f+=f27; 


printf (''£(%d)=%d",k,£); 
getch(); 
} 
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Computer Solution of Example 7.23 


Enter the no. of observations 


nter the different values of x 

5S 7 LL 13°17 

nter the corresponding values of y 

150 392 1452 2366 5202 

nter the value of 'k' in f(k) you want to evaluate 


£(9) = 810 


14.19 Derivatives Using Forward Difference Formulae 
[Section 8.2 (1)] 


Flow-chart 


Declare float 


°x, °y, max, °tmp, xval, 
XgY 9 yval, sum 


Y 


Input max 


float®) calloc (max, sizeof (float)) 
float*) calloc (max, sizeof (float)) 


i=0 


Input x{i], yli] 


i 


isi+l 


Input xval <— 


Pos =i 
x9 = x [pos] 
Yo = y [pos] 


Print x gy 9 
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—— 


h = x{1] -x[0] 
p = (xval-x ,)/h) 
] = max-pos 
tmp = (float*) calloc (max, sizeof (float)) 
i=0 


tmpli] = ylj] 
i=i+l 


j=j+l 


i=l 
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Y y 
j=9 
jel=i = 
Y y 


tmpli * 1 + j] = tmp [(i— 1)*l + G + 1)] -tmp[(i- 1)*1 j] 


y 


je ijit+l 


Sum = sum + ((1.04) * tmp[i_ *1 + 0]) *k 
k=-k 
i=i+l 


V[ | = {0, 0, 1.0, 1.0, 11.0/12.0, 5.0/6.0, 137.0/180.0} 


Y 
Sum = 0 ~~ 


k=1 


Yes 
Sum = sum + (v[i])* tmp[i *1 + 0] *k 
k=-k 


i=i+l 


ff Print sum/pow(h, 2.0) Wy 
1 


Program 
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/* Derivatives using forward difference */ 
#include<stdio.h> 
#include<math.h> 
#include<conio.h> 


void main( ) 


{ 


float *x=NULL, *y=NULL; 
*tmp1l=NULL; 


float *tmp=NULL, 


float xval,h,p,x0,y0,yval,sum; 


int pos,i,k,max; 


int v[]={0,0,1.0,1.0,11.0/12.0,5.0/6.0,137.0/180.0}; 
printf ("Enter the no of comparisons") ; 


scanf("%Sd", &max) ; 


x=(float*) malloc (max) ; 


x=(float*) malloc (max) ; 


tmp=(float*) malloc (max) ; 


printf ("Enter the values in cv table for x and y"); 


for (i=0;i<max;i+t+) 


{ 


printf("\n value for Sd x",i); 


scanf("%f£",&x[i]); 


} 


for (i=0; i<max; itt) 


{ 


printf("\n value for Sd y",i); 


scanf("S£",&y[i]); 


} 


printf ("Enter the value of x"); 


scanf("Sf£",&xval); 


for (i=0; i<max;itt) 


{ 


if (x[i]>=xval) 


{ 
pos=i; 
break; 


} 
x0=x[pos]; 
yO=y[pos]; 


printf("\n x0 is Sf yO is %f at %d",x0,y0,pos) ; 
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h=x[1]-x[0]; 
p=(xval-x0) /h); 
if (pos< (max) ) 


{ 


int fact=1,i,1, Jj; 
// calculating no of elemets in array 
l=max-pos; 
tmp=(float*)malloc(1*1); 
Prince ("\n") % 
for (i1=0;i<1;i++) 
{ 

for (j=0; j<=1; j++) 

{ 

tmp [i*1+j]=0; 

} 

printf("\n"); 
} 
printf("\n size of new array %d\n",1); 
// copying values of y in array 
for(i=0, j=pos;i<l;it+, j++) 
{ 

tmp[i] = yljl; 
} 
printf ("\n"); 
for (i=1;i<1;i++) 
{ 

for (j=0; j<l-i; j++) 

{ 


tmp [i*1+j]=tmp[(i-1)*1+(j+1)] -tmp[(i-1)*1+(j)]; 


} 
printf("\nvalues are \n"); 
for (1=0;i<1;i++) 
{ 
for(j=0; j<l; jt+) 
{ 
printf ("%.3f\t|",tmp[j*1l+i]); 
} 
printf ("\n"); 
} 


// appling newtons forward differnation using first 


derivates sum=0; 
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k=1; 
for(i=l; i<l; i++) 
{ 
sum=sumt ((1.0/i) *tmp[i*1+0]) *k; 
k=-k; 
} 
printf("\n\n first (dy/dx): %f ",sum/h); 
sum=0; 
fact=1; 
k=1; 
for (1=2;i<1;i++) 
{ 
sum=sumt+ (v[i]*tmp[i*1+0]*k; 
k= -k; 
} 
printf("\n\n second (dy/dx): Sf ",sum/pow(h,2.0)); 


} 
Computer Solution of Example 8.1 


value for 0x1.0 
value for Oy7.989 
value for 1x1.1 
value for 1y8.403 
value for 2x1.2 
value for 2y8.781 
value for 3x1.3 
value for 3y9.129 
value for 4x1.4 
value for 4y9.451 
value for 5x1.5 
value for 5y9.750 
value for 6x1.6 


value for 6y10.031 


Enter the value of x1l.1 

x0 is 1.1y0 is 8.403 at 1 

size of new aray 6 

values are 

1.18.403 |0.378 |-0.03 |0.004 |-0.001 |0.003 
1.2 8.781 |0.348 |-0.026 |0.003 |0.002 |0 | 
1.39.129 |0.322 |-0.023 |0.005 |0 |0 | 
1.49.451 |0.299 |-0.018 |0 |0 |0 | 
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125: 9.75 }0.281 |0 |0 |0 |0 | 
1.610.031 |0 10 10 10 10 | 
first (dy/dx): 3.952 
second (dy/dx): -3.74 


14.20 Trapezoidal Rule (Section 8.5—1) 


Flow-chart 


Y 
Define function y(x) 


Y 


[ce values of x0, xn, n / 


Loop fori = 1ton—-1 


Y 
s+ = 2*y(x0 + i*h) 


rs, 
End Loop (i) 


Y 


vA Print(h/2)* s as solution / 


NOTES: y(x) is the function to be integrated 


xO is Xo 


xN isx. 
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Program 


/* Trapezoidal rule.*/ 
#include <stdio.h> 
float y(float x) 
{ 
return 1/(1+x*x); 
} 
main () 
{ 
float x0,xn,h,s; 
int i,n; 


puts("Enter x0,xn,no. of subintervals"); 
scanf ("Sf S£ Sd", &x0,&xn, &n); 

h = (xn-x0) /n; 

s = y(x0)+y(xn); 

for (i=1;i<=n-1;i++) 
s += 2*y(x0+i*h); 

printf ("Value of integral is % 6.4f\n", 
(h/2)*s); 

} 


Computer Solution of Example 8.10 (I) 


Enter x0, xn, no. of subintervals 
0 6 6 
Value of integral is 1.4108 
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14. 


21 Simpson’s Rule (Section 8.5—II) 


Flow-chart 


y. 


Define function y(x) 


Y 


/' Get values of x0, xn, n / 


h = (xn —x0)/n 


Y 


s=y0+yn+ 4*yl 


¥ 


Loop fori=3ton-1 Step 2 


¥. 


s+ =4*yi + 2*yi-l 


Y 


End Loop (i) 


y. 


i Print (h/3)*s as solution 7 


<2 


NOTE: y(x) is the function to be integrated so that y, = y(x,) = y(x 


ih), 


0 


+ 


Program 


/* Simpson's rule */ 
#include <stdio.h> 
float y(float x) 

{ 


} 


return 1/(1+x*x) ; 


main () 


{ 
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float x0,xn,h,s; 
int i,n; 
puts("Enter x0,xn. no. of subintervals"); 
scanf("S£ %£ %d",&x0, &kn, &n); 
h = (xn-x0) /n; 
s = y(x0)+y(xn)+4*y(xO0th) ; 
for (i=3;i<=n-1;it=2) 
s t= 4*y(x0+i*h) +2*y(x0+(i-1)*h); 
printf("Value of integral is %6.4f\n", (h/3)*s); 
} 


Computer Solution of Example 8.10 (ii) 


Enter x0, xn, no. of subintervals 
0 6 6 
Value of integral is 1.3662 


14.22 Euler’s Method (Section 10.4) 


Flow-chart 


Y 
Define function df(x, y) 


Y 


Get values of x0, y0, h, x VA 


yl + = h*df(xl, yl) 
Y 
xl+=h 


fe Print xl, yl FA 
y 
Gy) 
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NOTES: df(x, y) is dy/dx 
ROIS eae, 
mI Sie a 
yO is yo 1-..Y, 
YL Is ys 
Program 
/*Euler's Method*/ 


# 
f 


{ 


} 


m 


{ 


include <stdio.h> 
loat df(float x,float y) 


return x+y; 


ain() 


float x0,y0,h,x,x1,yl; 

puts ("Enter the values of x0,y0,h,x"); 
scanf("Sf Sf Sf Sf£",&x0, &y0, &h, &X) ; 
x1=x0; yl=y0; 

while (1) 

{ 


if (x1l>x) return; 
yl += h*df(xl1,yl); 


xl += h; 

printf ("When x = %3.1f " 
"y = $4.2f\n",x1l,yl); 

} 

} 


Computer Solution of Example 10.8 


0) 
W 
W 
W 
W 
W 
W 
W 
W 


Enter the values of x0, yO, h, x 

Lgl. 

hen x = 0.1 y = 1.10 
hen x = 0.2 y= 1.22 
hen x = 0.3 y = 1.36 
hen x = 0.4 y = 1.53 
hen x = 0.5 y = 1.72 
hen x = 0.6 y = 1.94 
hen x = 0.7 y = 2.20 
hen x = 0.8 y = 2.49 
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When x = 0.9 y = 2.82 
When x = 1.0 y = 3.19 


14.23 Modified Euler’s Method (Section 10.5) 


Flow-chart 


Declare float 


x, y, S = 0.0, sl = 0.0, x1 = 0.0, yl = 0.0, h, 
ms = 0.0, flag = 0, y2=0.0,y3=0.0 ,t=0.0 


Yl=xl+y 
Y 
ra Print x1, yl,ms fo 
Y 


Y2 =y+h* ms 


ra Print y2 eA 
Y 
Xl=xl+h 
Fed 
Y 
ms = (yl +(xl + y2))/2.0 ;t=y+h* ms ~<—___Y 


ka y2=yl+h°* ms; f=0 


Y 
| y2=y +h* ms; —— 
Y 
le Print x1, y2, x1, ms, y2 ra 
le | Y = ms; flag = 0 en! 


C Stop >< Y 
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Program 


/* Modified 


Euler's Method */ 


#include<stdio.h> 
#include<math.h> 
#include<conio.h> 


void main( ) 


{ 


t x,y,x1l=0.0, yl=0.0,h,ms=0.0, flag=0, y2=0.0,t=0.0; 


floa 

ME, pays 
clrscr({ )+ 
printf ("\n 


Enter the value of x"); 


scanf ("SE", &x); 


prin 


tf£("Enter the value of y"); 


scanf ("Sf", &y); 
tf("enter the height"); 
scanf ("SE", &h); 


prin 


T=] % 


printf ("x") ;gotoxy(10,i) ;printf ("xty=yl") ;gotoxy (28,1); 


printf 


("mean slope") ;gotoxy (45,1); 


printf ("old y+.1(mean slope)=new y"); 


while (x1<x) 


{ 


i++; 


do 


{ 


i++; 


if (flag==0) 


{ 


yl=xlty; 


fe) 


gotoxy(2,1i);printf("S.1£",x1) ;gotoxy(10,1i);printf("% 


otoxy(28,i);printf£("S.5f",ms) ; 


m5=yl; 
y2=yth*ms; 
gotoxy(45,1i);printf("S.5f£",y2); 
xl=xlth; 

flag=1; 


2DE", yl) Fg 


>). SS: “> “> SS Oe 


oOOoO oO fo 
Nh NM NH ND + 


oO O Oo fo 
WWW WW NY 
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else 


ms=(yl+(xl+y2))/2.0; 
t=yth*ms; 
if (y2==t) 


y2=yth*ms; 
break; 
} 
gotoxy(2,1i);printf ("%.1£",x1);gotoxy(10,1i);printf("S.1f+%S.5f", 
x1,y2) ;y2=yth*ms; 
gotoxy(28,1i);print£("S.5f£",ms) ;gotoxy(45,1i);printf("S.5f£",y2); 
} 


}while (1); 
y=y2; 

printf ("\n\n"); 
flag=0; 


} 
} 


Computer Solution of Example 10.10 


nter the value of x.3 
nter the value of yl 
enter the height.1 


x +ye= yl mean slope old y +.1 (mean slope) = new y 
1 0 Ls. 

O.1 +1 L els 1.11 

OQ. L411 1.105 1.1105 
0.1 + 1.1105 1.10525 1.110525 
O.1 + 1.110525 1.105263 1.110526 
0.1 4 1.110526 1.105263 1.110526 
1.2105261.105263 1.231579 

0.2 +4 1.231579 1.321053 1.242632 
0.2 + 1.242632 1.326579 1.243184 
0.2 + 1.243184 1.326855 1.243212 
0.2 + 1.243212 1.326869 1.243213 
1.443213 1.32687 1.387535 
0.3 + 1.387535 1.565374 1.399751 
0.3 + 1.399751 1.571482 1.400362 
0.3 + 1.400362 1.571787 1.400392 
0.3 + 1.400392 1.571803 1.400394 


732 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


14.24 Runge-Kutta Method (Section 10.7) 


Flow-chart 


Y 
Define function f(x, y) 


Y 


feet values of x0, yO, h, xn / 
~<a 


No 


kl = h*f(x, y) 

k2 = h*f(x + h/2, y +k1/2) 
k3 = h*f(x + h/2 , y + k2/2) 
k4 = h*f(x+h ,y + k8) 

k = (kl + (k2 + k3)*2 + (k4)*6 
x=yth 


y=ytk 


Y 
iy Print x, y 7 
(20) 


NOTES: x0 is starting value of x, i.e., x, 


an is the value of x for which y is to be determined 


Program 


/* Runge Kutta Method */ 

#include <stdio.h> 

float f(float x,float y) 

{ 

return xty*y; 

} 

main () 

{ 

float x0,y0,h,xn,x,y,k1,k2,k3,k4,k; 
printf ("Enter the values of x0,y0," "h,xn\n"); 
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scanf ("Sf Sf Sf Sf", &x0, &y0, &h, &xn) ; 


while (1 

{ 

if (x == xn) break; 
kl = h*f (x,y); 
k2 = h*¥f(xth/2,ytk1/2); 
k3 = h*¥f (xth/2,y+k2/2) ; 
k4 = h*f (xth, y+k3) ; 
k = (k1+(k2+k3) *2+k4) /6; 
x += h; y t= k; 


printf ("When x = %8.4f£" 
"y = $8.4f\n",x,y); 
} 


} 
Computer Solution of Example 10.15 


Enter the values of x0, yO, h, xn 
020 °1.0 O42 O22 

When x = 0.1000 y = 1.1165 

When x = 0.2000 y 1.2736 
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14.25 Milne’s Method (Section 10.9) 


Flow-chart 


Y 


Define function correct Q) 


Get values of x0, ( ) C= or 
xr, h, aerr SS 
Y 


Get starting Call correct (c) 
values of y 
Y 


Calculate starting values of x 


Yes 


Prepare for next iteration 


Y 


x[4] = x[3] + h 
7 


Predict y(4) 
Y 


[Pin x(4), y(4), (4) / Calculate corrected Y(4) 
Y 
Call correct (c) Print y(4), f(4) 


o 


NOTES: x is an array such that x[i] represents x, , for e.g. x[0] represent 
xn 

y is an array such that y[i] represents y, |. 

xr is the last value of x at which value of y is required 

h is spacing in values of x 

aerr is the allowed error in value of y 

yc is the latest corrected value for y 

fis the function which returns value of y’ 

corect is a subroutine that calculates the corrected value of y and prints it. 


Program 


/*Milne predictor corrector*/ 

#include <stdio.h 

#include <math.h float x[5],y[5],h; float f(int i) 
{ 
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return x[i]-ylil*ylil; 
} 
void corect() 
{ 
yl4] = y[2]+(h/3) * (£(2) +4*£ (3) +£(4) ); 
printf("S23s %8.4f %8.4f \n", "",y[4],£(4)); 
} 
main () 
{ 
float xr,aerr,yc; 
int i; 
puts("Enter the values of x0,xr,h," 


"allowed error"); 
scant ("Sf S£ Sf Sf", 
&x[0],&xr,&h, &aerr); 


puts("Enter the value of y[i], i=0,3"); 
for (i1=0;1<=3;it+) scanf("%Sf",&y[il]); 
for (i=1;1i<=3;it+) x[i] = x[0]+i*h; 
puts(" x Predicted" 


" Corrected") ; 
puts (" y 5 iad "Vy EY) > 


while (1) 
{ 
if(x[3] = xr) return; 
x[4] = x[3] th; 
y(4] = y(0l]+ 
(4*h/3) * (2* (£(1) +£(3))-£(2)); 
printf("%6.2f 8.4f %8.4f\n", 
x[4],y[4],£(4)); 
corect(); 
while (1) 
{ 
ye = yl4]; 


corect(); 
if(fabs(yc-y[4]) <= aerr) break; 
} 
for (i=0;1i<=3;1i++) 
{ 
x[i] = x[it+l]; 
ylij] = ylitll; 
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Computer Solution of Example 10.19 


Enter the values of x0, xr, h, allowed error 
0 1.2.0001 
Enter values of y[il; i = 0, 3 
0.02.0795.1762 
x Predicted Corrected 
y Ey = 
0.80 0.3049 0.7070 
0.3046 0.7072 
0.3046 0.7072 
1.00 0.4554 0.7926 
0.4556 0.7925 
0.4556 0.7925 


14.26 Adams-Bashforth Method (Section 10.10) 


Flow-chart 


Declare float *x, *y, *f, h 


inti 
X = (float®) calloc (4, sizeof (float)) 
Y = (float®) calloc (4, sizeof (float)) 
i=0 


y Yes 


input x{i], yli] 


ed No 
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Yes 


yf Printf x[i], yi], fi] Va 


yl4] 
x[4] = 1.4; 


yL3] + ((h/24)* ((55° {13]) — (59° £[2]) + (37° f[1])-(9°f[0]))); 


f[4] = pow(s[4], 2)* (1.0 + yl4]); 


Yy 


Print x[4 


y [4] 114] 


Program 


/*Adams-Bashforth Method*/ 
#include<stdio.h> 
#include<malloc.h> 
#include<math.h> 
#include<conio.h> 


void main( ) 

{ 
tloat *x, “y,- *£), SELF 
float h; 
int i,size, row; 
elrscr(. ) 3 
printf("enter the siz 


scanf ("Sd", &Size); 
x=(float*)malloc(size + 
y=(float*)malloc(sizet+l 


) 
f1=(float*)malloc(sizetl 


f=(float*)malloc(size + 


3 
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for (i=0;i<size;itt) 
{ 
printf ("enter the value for x[%d]",i); 


scanf("S£",&x[i]); 
} 


for (i=0;i<size;itt) 


printf("enter the value for y[%d]",i); 


scanf("Sf",&yl[i]); 
} 
h=x[1]-x[0]; 
// calculating values (f) 
for (i=0;i<size;it+t) 
{ 
float tx,ty,tf; 
fflush(stdin); 
tx=x[i] 
ty=ylil; 
tf=(pow(tx,2)*(1.0+ty)); 
f[ij=tf; 


, 


} 

printf("\nvalues for (x) (y) and (f) are\n"); 
row = 16; 

for (i1=0;i<=3; i++) 

{ 


gotoxy(2,row) ;printf("x="); gotoxy(6,row) ;printf("%.1f",x[i]); 
gotoxy(13,row); printf ("y%d",i-3) ;gotoxy(16,row) ;printf ("="); 
gotoxy(18,row);printf ("Sf",y[i]); gotoxy (28, row) ;printf("f£%3d" 
pu=s) , 

gotoxy (32,row) ;printf ("="); gotoxy(35,row) ;printf("Sf",f[1i]); 
rowt++; 


} 


//using predicator 


y[size]=y[size-1]+((h/24)*((55*f[size-1])-59*f[size- 

2])+37*f[size-3]) 

-—(9*f[size-4]))); x[size] = 1.4; 
f[size]=pow(x[size],2)*(1.0+y[size]); 
gotoxy(2,row) ;printf ("x="); 

gotoxy (6, row) ;printf("%.1f",x[size]);gotoxy(13, row) ;printf ("yl 

");gotoxy (16, row) ;printf ("="); gotoxy(18,row);printf("%f",y[s 

ize]);gotoxy(28,row) ;printf ("f1") ;gotoxy (32, row) ;printf ("="); 


gotoxy(35,row);printf ("sf",f[size]); 
} 
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Computer Solution of Example 10.23 


nter the size 4 
nter the value for x[0]1.0 
nter the value for y[0]1.000 
nter the value for x[1]1.1 
nter the value for y[1]1.233 
nter the value for x[2]1.2 
nter the value for y[2]1.548 
nter the value for x[3]1.3 
nter the value for y[3]1.979 
values for(x) (y) and (f) are 
= y-3 =1 f-3 = 2 
= y-2 = 1.233 £-2 = 2.70193 
y-1 = 1.548 f-1 = 3.66912 


yO = 1.979 £0 = 5.03451 
yl = 2.572297f1 = 7.001702 


~ Mm mM Mm OM 
ll 

PPrPRPP 

Bw NE 
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14.27 Solution of Laplace Equation (Section 11.5) 


Flow-chart 


Initialize all points of 
mesh to be zero 


Y 
Get the Boundary 
conditions 
oy: 
Get values of 
aerr, maxitr 


Y 


Loop for itr = 1 to maxitr 


Y 
maxerr = 0 Print results of 
Y the iteration 


Loop for i= 2 to SQR-1 


Y 
Loop for j = 2 to SQR-1 


maxerr > = aerr ? 


Yes /Print array U 
as solution 


Y 


t= (U1) +U 415 FU j41 + Uj_D/4 


End Loop (itr) 


Y 
err = fabs (u; ; — T) | 


Is 


err > maxerr ? maxerr = err 


} 


Y 
End Loop (j) 


End Loop (i) 
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NOTES: SOR is the size of the square mesh 

u is a 2D Array representing the square mesh 

aerr is the allowed error 

maxitr is the maximum allowed iterations 

itr is a counter which keeps track of the number of iterations performed 
maxerr is the maximum error in the mesh in an iteration 

err is error in a particular point of the mesh 

f is the execution time format 

getrow is a subroutine that inputs the ith row of the mesh 

getcol is a subroutine that inputs jth column of the mesh. 


Program 


/* Laplace's Equation */ 
#include <stdio.h> 
#include <math.h> 
#define SOR 4 
typedef float array[SQR+1] [SQR+1]; 
void getrow(int i,array u) 
{ 
int Jj; 
printf("Enter the values of u[%d,j]," 
"43=1,%d\n",i,SQOR); 
for (j=1;3<=SOR;j++) 
scanf ("SE£", éu[i] [j]); 
} 
void getcol(int j,array u) 
{ 
te “a3 
printf ("Enter the values of u[i,%d]," 
"i=2,Sda\n",3,SQR-1); 
for (i=2;i<=SQR-1; i++) 
scanf ("Sf£",éuli][j]); 


} 
void printarr(array u,int width,int precision) 

{ 

int i,j; 

for (i=1;i<=SQR; i++) 

{ 

for (j=1;3<=SQR; j++) 
printf ("S7.2£%7.2£%7.2£",width,precision, u[i][j]); 


742 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


printf("\n"); 


array u; 
float maxerr,aerr,err,t; 
int i,j,itr,maxitr; 
for (i=1;i<=SQR; i++) 

for (j=1; j3<=SQR; j++) 

uli] [j]=0; 

puts ("Enter the boundary conditions") ; 
getrow(1,u); getrow(SQR,u) ; 
getcol(1,u); getcol(SQR,u); 
puts ("Enter allowed error," 


"maximum iterations"); 
scanf ("Sf S£",&aerr, &Maxitr); 
for (itr=l;itr<=maxitr;itrt+t) 
{ 
maxerr=0; 
for (i=2;i<=SQR-1; i++) 
for (j=2; ]<=SQR-1; j++) 
{ 


t=(uli-1)] [f]+ulitl] [1+ 
uli] [j+1]+u[i] [j-1])/4; 
err=fabs(u[i][j]-t); 


if (err > maxerr) 
maxerr = err; 
uli] [j]=ts 
} 
printf ("Iteration no. Sd \n",itr); 
printarr(u,9,2); 
if (maxerr <= aerr) 
{ 
printf ("After %d iterations \n" 
"The solution:-\n",itr); 
printarr(u,8,1); 
return 0; 


} 
puts ("Iterations not sufficient."); 
return 1; 
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} 
Computer Solution of Example 11.3 (A) 


Enter the boundary conditions 

Enter the values of u[l, j]J, 3 = 1, 4 

1000 1000 1000 1000 

Enter the values of u[4, jJ, 3 = 1, 4 

1000 500 0 0 

Enter the values of u[i, 1], i= 2, 3 

2000 2000 

Enter the values of u[i, 4], i= 2, 3 

500 0 

Enter allowed error, maximum iterations 

.1 10 

Iteration No.1 

1000.00 1000.00 1000.00 1000.00 
2000.00 750.00 562.50 500.00 
2000.00 812.50 343.75 0.00 
1000.00 500 0.00 0.00 
Iteration No. 2 

1000.00 1000.00 1000.00 1000.00 
2000.00 1093.75 734.38 500.00 
2000.00 984.38 429.69 0.00 
1000.00 500.00 0.00 0.00 
Iteration No.3 

1000.00 1000.00 1000.00 1000.00 
2000.00 1179.69 777.34 500.00 
2000.00 1027.34 451.17 0.00 
1000.00 500.00 0.00 0.00 
Iteration No. 4 

1000.00 1000.00 1000.00 1000.00 
2000.00 1201.17 788.09 500.00 
2000.00 1038.09 456.54 0.00 
1000.00 500.00 0.00 0.00 
Iteration No. 5 

1000.00 1000.00 1000.00 1000.00 
2000.00 1206.54 790.77 500.00 
2000.00 1040.77 457.88 0.00 
1000.00 500.00 0.00 0.00 
Iteration No. 6 

1000.00 1000.00 1000.00 1000.00 
2000.00 1207.89 791.44 500.00 
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2000.00 
1000.00 
Iteration No. 
1000.00 
2000.00 
2000.00 
1000.00 
Iteration No. 
1000.00 
2000.00 
2000.00 
1000.00 


a 


1000.0 
2000.0 
2000.0 
1000.0 
1000.0 
2000.0 
2000.0 
1000.0 


[The solution:- 


[The solution:- 


1041.44 
500.00 
7 
1000.00 
1208.22 
1041.61 
500.00 
8 
1000.00 
1208.31 
1041.65 
500.00 


After 8 iterations 


1000.0 
1208.3 
1041.6 
500.0 


1000.0 
1208.3 
1041.6 
500.0 


458.22 
0.00 


1000.00 
791.61 
458.30 
0.00 


1000.00 
791.65 
458.33 
0.00 


1000.0 
791.7 
458.3 
0.0 


1000.0 
791.7 
458.3 
0.0 


0.00 
0.00 


1000.00 
500.00 
0.00 
0.00 


1000.00 
500.00 
0.00 
0.00 


1000.0 
500.0 
0.0 
0.0 


1000.0 
500.0 
0.0 
0.0 
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14.28 Solution of Heat Equation (Section 11.9) 


Flow-chart 


Y 
Initialize H, K 


Y 
Define Function f(x) 


Y 
/ Get the value of csqr oy 


Y 
alpha = (csqr*k)/(h*h) 


Y 


/ Get value of ust, uet j 


Y 
Make entries in Ist Col. 
equal to ust and 2nd Col. 
equal to uet 


Y 
Calculate entries of the 
first row 


Y 
Calculate entries of the 
remaining rows 


Y 


/ Print alpha / 


Y 


Print Array u 
as solution 
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NOTES: XEND is the ending value of x 
TEND is the ending value of t 

h is the spacing in values of x 

k is the spacing in values of y 

f(x) is value of u(x, 0) 

csqr is value of C? 

alpha is a 

ust is the value in the first column 

uet is the value in the last column. 


Program 


/*Solution of parabolic equations by Bendre 
Schmidt method*/ 
#include <stdio.h> 
#define XEND 8 
#define TEND 5 float £f(int x) 
{ 
return 4*x-(x*x)/2.0; 
} 
main () 
{ 
float u[XEND+1] [TEND+1],h=1.0,k=0.125, 
csqr,alpha,ust,uet; 


BB ola eae Ores 
puts("Enter the square of 'c'"); 
scanf("Sf",&csqr); 
alpha = (csqr*k)/(h*h) ; 
puts ("Enter the value of u[0,t]"); 
scant ("S£", éust); 
printf ("Enter the value of u[%d,t]\n", 
XEND); scanf ("Sf£", &uet); 
for (j=0;j<=TEND; j++) 
u[0] [3 ]=u[XEND] [j]=ust; 
for (i=1;i<=XEND-1;i++) 
u[i] [O]=f£(1); 
for (j=0;j<=TEND-1; j++) 
for (i=1;i<=XEND-1;i++) 
u[i] [j+1]= 
alpha*u[i-1] [3 
+(1-2* alpha) *u[i] [3] 
talpha*ulitl] [3]; 


oOOoOOoOO oO oO 
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printf("The value of alpha is %4.2f\n", alpha); 


puts("The values of u[i,j] are:-"); 
for (j3=0;j<TEND; j++) 
{ 


for (i=0;1<XEND;i++) 
printf ("%7.4f",ulil[j]); 
printf ("\n"); 
} 
} 


Computer Solution of Example 11.11 


Enter the square of "c" 
4 
Enter value of u(0, t) 
0 
Enter value of u(8, t) 


The value of alpha is 0.50 


The values of u(i, Jj) are:- 


-0000 3.5000 6.0000 7.5000 8.0000 7.5000 6.0000 
0000 3.0000 5.5000 7.0000 7.5000 7.0000 5.5000 
0000 2.7500 5.0000 6.5000 7.0000 6.5000 5.0000 
0000 2.5000 4.6250 6.0000 6.5000 6.0000 4.6250 
0000 2.3124 4.2500 5.5625 6.0000 5.5625 4.2500 
0000 2.1250 329375 5.1250 5.5625 5.7250 3.9375 


NM MN DN W W 


- 5000 
0000 
. 7500 
- 5000 
23125 
1250 


oo Oo 2 2 & 


0000 
0000 
0000 
0000 
0000 
0000 
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14.29 Solution of Wave Equation (Section 11.12) 


Flow-chart 


Y 
Define Function f(x) 


Y 


/' Get the value of csqr 


Get the value of ust, uet 


Y 
Make entries in 1st Col. 
equal to ust and in last 
equal to uet 


| 


Calculate entries of 
1st row and copy 
them to 2nd row 


Y 
Calculate entries for 
rest of the rows 


Y 
Print Array u 
as solution 


Y 


CoD 


Notes: XEND is the ending value of x 

TEND is the ending value of t f(x) is value of u(x, 0) 
csqr is value of C? 

ust is the value in the first column 

uet is the value in the last column 


Program 


/* Solution of Hyperbolic equation */ 
#include <stdio.h> 

#define XEND 5 

#define TEND 5 float f(int x) 

{ 


return x*x* (5-x); 
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} 

main () 

{ 

float u[XEND+1] [TEND+1],csqr,ust,uet; 
int i,j; 


puts("Enter the square of 'c'"); 

scanf ("%d", &csqr) ; 

printf("Enter the value of u[0][t]\n"); 
scant ("st", cust) + 


printf("Enter the value of u[%d][t]\n", 
XEND); scanf("%Sf£",&uet) ; 


for (j3=0; 3<=TEND; j++) 
{ 
u[O][j] = ust; u[XEND] [3] = uet; 
} 
for (i1=1;1<=XEND-1;1i++) 
u[fiJ [1] = uf[i] [0] = £(1); 
for (j=1;3<=TEND-1; j++) 
for (i=1;i<=XEND-1; i++) 
uli] [jt1] = ufli-1]) (j]tulitt) [3] 
-uli)] [3-1]; 
puts("The values of u[i][j] are:-"); 
for (j=0;j<=TEND; j++) 
{ 
for (i=0;1i<=XEND; i++) 
printf ("S6.1f£",u[i][j]); 


pranti("\n") #7 
} 
} 


Computer Solution of Example 11.14 


Enter the square of "c" 

16 

Enter value of u(0, t) 

0 

Enter value of u(5, t) 

0 

The values of u(i, Jj) are:- 
0.0 4.0 12.0 18.0 16.0 0.0 
0.0 6.0 11.0 14.0 9.0 0.0 
0.0 7.0 8.0 2.0 -2.0 0.0 
0.0 2.0 -2.0 -8.0 -7.0 0.0 
0.0 -9.0 -14.0 -11.0 -6.0 0.0 
0.0 -16.0 -18.0 =12.0 -4.0 0.0 
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14.30 Linear Programming—Simplex Method (Section 12.8) 


Flow-chart 


y 
Initialize all arrays to zeros 


Set coefficients of slack 
variables equal to 
one, ina 


Put slack variables 
in the basis 


Y 
Get the constraints and 
the objective function 


Y 
Calculate cand identify 
the incoming variable 
Y 


Are 
all c; <0? 
optimality test) 


Calculate the 
optimal solution 


¥. 
Print the Optimal Solution 


Calculate values 

of 8 z 
Are 
all @ <0 ? 


(unbounded 
solution) 


Print ‘Unbounded 
Solution’ 


y No 


Search for outgoing variable 


¥: 
Divide key row by 
key element 


Y 


Make all other elements 
of key column zero 


@) 
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NOTES: ND is number of decision variables 

NS is number of slack variables 

a is the array containing Body Matrix, Unit Matrix and b/s 

c is an array containing values of c's 

cb is an array containing values o Cys 

th is an array containing values of 6's 

bas is basis. For xi’s basis contains i, for si’s basis contains i + ND 
ki is the key row 

kj is the key column. 


Program 


/* Linear programming by simplex method */ 
include <stdio.h> 

define ND 2 

define NS 2 

define N (ND+NS) 

define Nl (NS*(N+1) ) 

void init(float x[],int n) 


int i=0; 

for (ji<nevr+) x(a) = dz 
} 
main () 


{ 

int i,j,k,kj,ki,bas[NS]; 

float a[NS] [N+1],c[N],cb[NS],th[NS], 
x[ND],cj,z,t,b,min, max; 

/* Initializing the arrays to zero */ 


init(c,N) 7; init (cb,NS); 
init(th,NS); init(x,ND); 
for (i=0;1i<NS;it++) init(a[i],Nt1); 


/* Now set coefficients for slack 
Variables equal to one */ 


for (i=0;1<NS;i++) a[i][i+ND] = 1.0; 
/* Now put the slack variables in the basis */ 
for (i=0;i<NS;i++) bas[i] = ND+ti; 


/* Now get the constraints 
and the objective function */ 


puts("Enter the constraints"); 
for (i1=0;i<NS;i++) 
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for (j3=0;3<ND; j++) 
scanf("S£",é&al[i] 
scanf("%£",é&a[i] [N 
} 
puts ("Enter the objective function") ; 
for (j=0;3<ND; j++) 
scanf("Sf",&c[j]); 
/* Now calculate cj and identify the incoming variable */ 
while (1) 
{ 
max = 0; kj = 0; 
for (j3=0;3<N; j++) 
{ 


z= 0; 
(i1=0;1<NS;1i++) 
z += cbh[i]l*alil(jl; 
cj = clj]-z; 
if(cj > max) 
{max = cj; kj = j;} 


for 


} 
/* Apply the optimality test */ 
if(max <= 0) break; 
/* Now calculate thetas */ 
max = 0; 
for (i=0;i<NS;i++) 
if(a[i] [kj '= 0) 
{ 
th[i] = ali] (N]/alil [kj]; 
if(th[i] > max) max=th[i]; 


} 


/* Now check for unbounded soln. */ 
if(max <= 0) 
{ 
puts ("Unbounded solution") ; 
return 2; 


} 


/* Now search for the outgoing variable */ 
min = max; ki = 0; 
for (i=0;i<NS;i++) 

if ((th[i] < min) &&(th[i] != 0)) 

{ 
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min = th[i]; ki = i; 
} 
/*Now a[ki] [kj] is the key element*/ 
t = a[ki] [kj]; 
/*Divide the key row by key element*/ 
for (j=0;3<N+1;j++) a[ki][j] /= t; 
/* Make all other elements of key coloumn zero */ 
for (i=0;i<NS;i++ 
if(i != ki) 


{ 


b = ali] [kj]; 
for (k=0;k<N+1; k++) 
afi] [k]-=a[ki] [k]*b; 
} 
cb[ki] = c[kj]; 
bas[ki] = kj; 
} 
/* Now calculating the optimum value */ 
for (i=0;i<NS;1i++) 
if ((bas[i] >= 0) && (bas[i]<ND) ) 
= alil [N]; 


x[bas[i 
z= 0; 
for (i=0;i<ND;i++) 
z += c[i]*x[i]; 
for (i=0;i<ND;i++) 
printf ("x[%3d] = $7.2f\n",itl,x[i]); 
printf ("Optimal value = %7.2f\n",z); 
} 


Computer Solution of Example 12.4 


Enter the constraints 

4 2. 80 

2 5 180 

Enter the objective function 
3 «4 

x[ 1] = 2.50 

x[ 2] = 35.00 


Optimal value = 147.50 


Computer Solution of Example 12.16 


Enter the constraints 
2 3 2 440 
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2 


4 


0 3 470 
5 0 430 


Enter the objective function 


3 6 


x[ 1] = 0.00 

x[ 2] = 42.22 

x[ 3] = 156.67 

Optimal value = 1066.67 


Exercises 14.1 


10. 


. Write a C program which prints all odd positive integers less than 100, 


omitting those integers divisible by 7. 


. Write a C program to convert a binary number to its equivalent decimal 


number. 


. Write a program to calculate N ! and use this to evaluate 


N! 
N.. =——— 
Ck  K\(N—K)! 


. Determine the number of integers n, 1 <n < 2000, that are not divisible 


by 2, 3 or 5 but are divisible by 7. 


. Write a program to evaluate the roots of the equation ax” + bx + c = 0. 


. Write a computer program in “C” for finding out a real root of the equa- 


tion f (x) = 0 by bisection method. 


. Write a C program to find a real root of x° — 4x — 9 = 0 using the method 


of false position. 


. Write an algorithm for the Newton-Raphson method to solve the equa- 


tion f(x) = 0. Apply the same to solve the cos x — xe* = 0 near x = 0.5 cor- 
rect to three decimal places. 


. Write a C program to solve the following equations by the Gauss-Seidal 


method: 83x + lly — 4% = 95; 7x + 52y + 18z = 104; 3x + 8y + 292 = 71. 


With the help of a flow chart, write a C program to solve: 
7.5x + 3.8y + 2.9% = 15; 3.26 + 6.8y + 7.4z = 37; 1.3x + 2.1y + 3.2z = re 
using the triangularization method. 
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11. Write a complete C program to (i) add two matrices (ii) multiply two 
matrices. 

12. Given the data: 
i: 5 10 15 20 25 30 
y: LF, 25 30 33 36 38 
Write a C program to fit a quadratic relation using the least squares cri- 
terion. 


13. Write a program in C to estimate (0.6) by the Lagrange interpolation 
for the following values: 


Xi 0.4 0.5 0.7 0.8 
f(x): —0.916 -0.693 -0.3857 —0.223 
10 


14. Write a C program to evaluate f x(x” + 2)dx using the Simpson’s rule. 


2 


10 
15. Write a C program for evaluation of rf f (x)dx by the Simpson’s 3/8th 


rule. 
16. Write a program in C for the second order Runge-Kutta method. 


17. Develop a “C” program for solving differential equations using the 
Runge-Kutta fourth order formulae. 


18. Write a C program to find y(0.8) for the differential equation 
dy/dx = lt + y), given the following table, using Milne’s Predictor- 


Corrector method: 


a: 0 0.2 0.4 0.6 
y: 2 2.636 3.595 4.968 


19. Write a computer program in C to maximize 
z= 6x, + 4x, 
subject to 2x, + 3x, $100, 4x, + 2x, < 120, x,, x, 2 0, where x,, x, 
are the number of items to be produced. 


20. Develop a computer program in C for Example 12.17 and solve it. 


CHAPTER 


NUMERICAL METHODs USING 
C++ LANGUAGE 


Chapter Objectives 
e Introduction 
e An overview of C++ features 


e Programs of standard methods in C++ language 


15.1 Introduction 


C++ is a general purpose programming language, originally de- 
signed by Bjarne Stroustrup. 

C++, a powerful language, is used for many purposes like 
writing operating systems, business, and scientific applications. It 
is not tied to any particular hardware and programs written in C++ 
are portable across any system. The programs written in C++ are 
efficient and fast. It is one of the most popular computer languages 


today. 


An overview of C++ features is given below for ready refer- 
ence. It is followed by Programs of Standard Numerical methods 
in C++ alongwith input/output of numerous examples solved in the 
Chapters 1 to 12. 
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15.2 An Overview of C++ Features 


C++ constants are numbers, which do not change during execution of 
a program. These may be of three types: 


Type Example 
Integer 27, 10897 etc. 
Floating point (Real) 2.723, — 0.123 ete. 
String “Enter the value” 


NOTE § The string constants are enclosed in double quotes (“). 


C++ variables can contain different C++ constants during the execution 
of the program. These are declared in a C++ program by first specifying the 
type int for an integer and float for the floating point and then the variable 
names separated by commas. The general format is 


type list of variables 
For e.g., to declare integer variables the statement is 
int a, b,c; 
and to declare a floating point variables it is 
float a, b,c: 


Variables can be initialized at the same time as they are declared. For 
example, 


float a = 1.5; 
declares a as a float variable having a value 1.5. 
Rules for naming C++ variables: 


(i) A variable name may contain only alphabets, digits, and the 
underscore (_). 


(ii) It must begin with a alphabet or an underscore. 
(iii) It can be as long as you wish, but on some C++ systems only the 


first thirty-one characters are considered. 


NOTE  Lower-case and upper case alphabets are treated as different 
in C. For e.g., Num and num are two entirely different variable 
names. As a matter of convention, lower- case alphabets are used. 
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Arrays. An array is an aggregate of variables of the same type. These vari- 
ables are called elements of the array. The following statements declare 
arrays in C: 


int b[10]; 
float —c[2][2]: 


The first statement creates a one dimensional array named b having 
ten elements, each element being referred by an appropriate subscript in 


rectangle brackets, i.e., b[0], b[1]......., b[9]. 


The second statement creates a 2-dimensional array named c having 
four elements c[0][0], c[0][1], c[1][0], c[1][1]. 


Rules for the naming of arrays are same as those for variable names. 


NOTE Subscripts always start from zero in C++. 


User defined types. Apart from the built in types int and float C++ allows 
users to define an identifier that can represent an existing data type. 


The syntax is 
typedef type identifier 
For e.g., 
typedef int number; 
typedef float matrix [2][2]; 


The first statement defines number to mean the same as int. The sec- 
ond defines matrix to be mean the same as 2 x 2 array of float. 


The above two statements enable declarations of the form number a, 


Dies 
which declares three integers a, b, and c, and 
matrix x; 


which declares a two-dimensional array x having four elements x[0][0], x[0] 


[1], x[1][0] and x[1][1]. 
Initialization of arrays at the time of declaration 
The syntax is 
type array-name [size] = {list of values} 


forég@, imtal2] = (2, 1}: 
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initializes a[0] to 2 and a[1] to 1. 
int a[2][2] = {{0, 1}, {3, 5}; 
initializes a[0][0] to 0, a[0] [1] to 1, a[1][0] to 3 and a[1][1] to 5. 


Arithmetic operators. These are as follows: 


Symbol Use 
+ Addition 
- Subtraction 
- Multiplication 
/ Division 


while using the operators, the following order of precedence is adopted 


In this case, the order of operators is that different circular brackets are 
used. 


There is no exponentiation operator in C, but there are various library 
functions avail- able for the same. 


For e.g., to calculate the square root sqrt function is used. 
Further details on functions are presented later. 
Mathematical expressions consist of a sequence of arithmetic operators 


and variable names, For e.g., 


(i) a + bis written as a + b. 


oe a . . 
(ii) —+c is written as a/b +c 


b 
(iti) 


7 r ; is written as a/(b + c) 

(iv) Vb? —4ac is written as sqrt (b*b — 4*a*c). 

(v) a(6 + y) is written as alpha * (beta + gamma). 

(vi) a is written as exp (b*In (a)) 
NOTE | The multiplication operator * has to be written explicitly. In 
C++, its presence is never assumed. 


exp and In are library functions. 
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Arithmetic statements are of the form 
var = exp; 
where var is an integer or a floating point variable. 
exp is a mathematical expression written in C++ format. 
The = sign has a special meaning. It tells C++ to calculate the value of 
exp. and assign it to var. 
For e.g., n=i* i; 


calculates the value of i * i and assigns the result to the variable n. If 
i = 10, then n gets the value 100. 


A C++ statement is always terminated by a semi colon (; ). 
C++ also permits statements of the type k =n =i * i; 
This is equivalent to the following statements n = i * i; k = n; 


<< 


NOTE _ 7o test the equality of two expressions C++ uses “= =”. 


Shorthand assignment operators 


Apart from the assignment operator =, C++ can also support certain short 
hand assignment operators (+ +, —-, + =, — =, * =, / =). Their use is illus- 


trated by the following examples. 


Statement using the Statement using the 
assignment operator shorthand assignment operator 
a=a+l1 a++or++a 
a=a-1 a——or--a 
a=a+4 a+=4 
a=a-4 a-=4 
a=a*4 a*=4 
a=a/la4 a/l=4 


NOTE The use of shorthand assignment operators not only results in 
concise programs but more efficient programs also. 


Comments in C++ are of two types. One is single line and other is multi 
line. Single line comments start with “//” 
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Multiline comments start with “/*” and end with “*/”. 


NOTE Multiline comment can be used for one or more lines. This is the 


style that has been followed in this book. 


€.g., 
Single line comment _//Euler’s Method 
Multiline comment  /*Euler’s Method*/ 
Input statement is cin. 
Syntax cin >> variablel >> variable2......; 
An example of the cin statement: 
Assuming the declarations 
int c; 
float a[3][3]; 
the statement 
cin >> c >> a [1][2]; 
takes input from the user and stores it in the corresponding variables. 
Output statement is cout 
Syntax cout << argumentl << manipulator] << argument? <<......; 
The arguments can be C++ constants or variables. 
Manipulators 


These are used for formatting the output. The manipulators used in this 
book are explained below: 


setw (w) 


where w specifies the minimum width (i.e., number of digits) for output. 
The width set with setw only applies to the next argument printed. So setw 
must be used prior to each argument where a specific width is desired. 


€.g., 
the statement 


cout << setw (3) << 1 
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will output 
bb1 


where b is a blank space. 
Setprecision (p) 
where p is the precision with which numbers are output. 


For fixed format, the precision is the number of digits in the fractional 
part, while for scientific format, precision is the total number of digits (both 
before and after the decimal point). The default precision in C++ is 6. 


The precision set with setprecision remains in effect, until the next set- 
precision. 


fixed 
By default scientific format is used in C++, i.e., the precision set with 


setprecision applies to the entire number. In this book, we will be using the 
fixed format. This is done by using the fixed manipulator. 


e.g. 
(i) for the following statement 
cout << 97.0/7.0; 
the output will be according to C++ default precision, i.e., 6 
13.8571 (total number of digits is 6) 
(ii) for the following statements 
cout << setprecision (5); 
cout < 97.0/7.0;: 
the output will be 
13.857 (total number of digits is 5) 


(iii) Now to get 5 digits in the fractional part, consider the following 
statements cout << fixed; 


cout << setprecision (5); 
cout < 97.0/7.0; 

the output will be 
13.85714 


endl—This causes the output to start from the next line. 
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NOTE To use the manipulators include the statement # include < 


iomanip.h > in the beginning of your program. 


Relational operators available in C++ are: 


Mathematical symbol C++ symbol 
> > 
= >= 
< < 
< <= 
# | = 


Logical expressions are mathematical expressions connected by relation- 


al op- erators. Their value is either true or false. 


Examples of logical expressions: Assuming i = 2, j = 3 


i <j is true 


i = =/is false 


(i*7) > (i +/) is true. 


In C++ the result of a logical expression is an integer. 0 is taken as false, 


any non-zero integer is taken as true. 


Logical operators are used to test more than one conditions, i.e., to com- 


bine more than one logical expressions. 


Logical operator 


AND 
OR 
NOT 


C symbol 


&& 
| 


| 


The following tables illustrates their use. 


Logical expression 1 


True 
True 
False 
False 


AND 
Logical expression 2 
True 
False 
True 


False 
OR 


Result 


True 
False 
False 
False 
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Logical expression I Logical expression 2 Result 
True True True 
True False True 
False True True 
False False False 
NOT 
Logical expression Result 
True False 
False True 


Decision making statement—If 
Syntax 
if (Lexp) 
{Tstatements} 
else 
{F statements} 
where Lexp is a logical expression. 
Tstatments are C++ statements executed when value of Lexp is true. 
Fstatments are C++ statements executed when value of Lexp is false. 
The else part is optional. 
Loops 
i) While Loop 
Syntax 
a) while (Lexp) 
{statements} 
b) do 
{statements} 
while (Lexp) 


Both these forms of the while loop cause execution of statements while 
value of Lexp is true. The difference between the two forms is that in the 
latter, the statements are executed at least once irrespective of the value of 
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Lexp. 
(ii) For loop 
Syntax 
for (initialization statement; Lexp; increment statement) 
{statements} 


The loop is best explained by the following flow chart: 


! 


Initialization statement 


! 


Rest of the program 


| Statements 


Increment statement 


Break statement. When a break statement is encountered inside a loop, 
that loop is exited, irrespective of the value of Lexp, and the program con- 
tinues with the statement immediately following the loop. 


Functions. These are the basic block of a C++ program. Functions contain 
State- ments that specify what is to be done. 


Every program has to contain a function named main. The program 
begins executing at the first statement of main. Apart from main the C++ 
functions are classified into 


— Library functions 
— User defined functions 
These functions are called from main to accomplish various tasks. 


(i) Library functions are already available and we just have to use 
them, e.g., cout, cin, sqrt, cos, sin, fabs (used to get the absolute 
value of a floating point variable), etc. 
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(ii) User defined functions have to be written by the user in the 
program. 


Syntax 
return-type function-name (Argument-list) 
{ 
statements 


} 


Program for understanding the various terms and concepts related 
with functions: 


1./* Sample program * / 
2. # include <isostream.h> 
3. float add (float a, float x); 
4. void half (float *x) 


a 

6.° 6H 2: 

7. return; 

8. } 

9. int main ( ) 
10. { 


11. float a = 2,b = 2,¢; 

12. c = add (a, b); 

13. cout << a<<b<<c << endl; 
14. half (&a); half (&b); 

15. cout <<a <<b<<c << endl; 
16. return 0; 

W744 

18. float add (float a, float x) 

19. { 

20. float sum; 
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21.sum =a +4; 

22. a = 20, x = 20; /*changing the formal arguments*/ 

23. return sum; 

24, } 

[Line numbers have been added for reference purpose and are not part 
of the program. | 
(a) Declaration and Definition 

Line number 3 is the declaration of the function named add. It indi- 
cates that there is a function add which takes two arguments, a and b both 
of type float and returns a float, i.e., the Argument list is float a, float b and 


return-type is float (which can be void if function doesn’t return anything— 
see line 4. It also indicates that the function is defined later in the program). 


Lines 18-24 are the definition of the function add i.e., they define how 
the function will make use of the arguments it received and return the re- 
quired sum. 


Lines 4-8 constitute both the declaration and definition of the function 


half. 
(b) Calling a function 


Line no. 12 calls the function add with a and b as arguments and stores 
the value returned by it into the variable c. 


(c) Actual and Formal arguments 


The variables a and x in the declaration of function add are called the 
formal arguments (line 3). 


The variables a and b in the call to the function (line 12) are the actual 
arguments. 


(d) Call by value/Call by reference 


In C++ language the values of actual arguments are always copied to 
the formal arguments when a function is called. This way of passing argu- 
ments is called call by value. In this any change made to the formal argu- 
ments in the function does not affect the value of actual arguments. 


But in other languages, notably FORTRAN any change made to the 
formal arguments is re- flected in the actual arguments. This is called call 
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by reference, as the formal argument is treated just another name for the 
actual argument. Both of them refer to the same location in the computer's 
memory. 


(e) Simulating a call by reference in C++ 


The following thumb rule can be followed to make the formal argu- 
ment refer to the actual argument (and not just receive a copy of it) 


“Precede the actual argument with an ampersand & (line 14) and pre- 
cede the formal argument with an asterisk * (line 4).” 


The actual working of this involves the concepts of pointers, which are 
another data type in 


C++. The reader can refer to any standard C++ book for a complete 
understanding. 


(f) Return statement in a function passes the control back to the calling 
function along with the calculated value (line 23) 


Syntax return expression; 


The expression can be omitted, in this case the return statement causes 
the function to just terminate then and there and pass control back to the 
calling function (line 7). 


In case no return statement is present in a function, an implicit return 
takes place on encoun- tering the right curly brace }. 


Preprocessor directives. The lines in a C++ program that begin with a 
hash (#) sign are called preprocessor directives. The two most commonly 
used are # define and # include. 


NOTE There is no semi colon (; ) after the directive. 


(i) # define 
syntax 
# define name replacement 


It instructs the computer to replace all occurences of name with the 
replacement even before the program is processed, i.e., checked for syntax. 


e.g., consider the following statements 
# define N 2 int a[N]; 
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Before the program is processed by the compiler, the second line, i.e., 
int a[N]; is changed to int a[2]; and the first line is removed. 


. The resulting statement that is processed is int a[2]. 
(ii) # include 

syntax 

# include < header-file-name > 


This instructs the computer to insert the contents of the mentioned 
header file at the place where the directive appeared. 


NOTE | Zhe header file contains declarations of various functions and 
many preprocessor directives. 


Object-oriented Programming (OOP) is a programming paradigm that 
uses “objects and classes’—data structures consisting of datafields and 
methods together with their interactions to design applications and com- 
puter programs. Programming techniques may include features such as, 
data abstraction, encapsulation, modularity, polymorphism, and inheri- 
tance. It was not commonly used in mainstream software application devel- 
opment until the early 1990s. Many modern programming languages now 
support OOP. 


An object is actually a identifiable identity with some characteristics 
and behavior, all relating to a particular real-world concept such as a bank 
account holder or player in a computer game. Other pieces of software can 
access the object only by calling its functions and procedures that have been 
allowed to be called by outsiders. 


For example, the player’s functions might include one to reveal the 
player’s configuration on the field. The account holder’s functions include 
one to reveal the current balance or to withdraw out or to deposit a sum. 


Procedural vs. OPP Programming. In procedural programming the em- 
phasis is on the programming where each statement tells the computer to 
do something. The focus is on processing the algorithm needed to perform 
the desire computation. 


Also procedural programming is not according to the real world, i.e., it 
is not close to the real world, “The world in which we live the activities we 
perform.” 
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Limitation of procedural programming 
(i) Emphasis on algorithm rather than data 
(ii) No reusability of code 
(iii) No overloading 
(iv) No real world model. 


OOPs Programming: Object-oriented programming has roots that can be 
traced to the 1960s. As hardware and software became increasingly com- 
plex, quality was often compromised. Researchers studied ways to maintain 
software quality and developed object- oriented programming in part to 
address common problems by strongly discrete, reusable block of program- 
ming logic. It focuses on data rather than processes, with programs com- 
posed of self-sufficient modules (objects) each containing all the informa- 
tion needed to manipulate its own data structure. This is in contrast to the 
existing modular programming which had been dominant for many years 
that focused on the function of a module, rather than specifically the data, 
but equally provided for code reuse, and self-sufficient reusable units of 
programming logic, enabling collaboration through the use of linked mod- 
ules (subroutines). This more conventional approach, which still persists, 
tends to consider data and behavior separately. 


OPP Terminology and Features: The OOP approach (based on certain 
concepts) 


helps to overcome the drawbacks of procedural programming. 


1. Data abstraction—refers to the act of representing essential features 
without including the background detail of explanations. For example, 
a class Car would be made up of an Engine, Gearbox, Steering objects, 
and many more components. To build the Car class, one does not need 
to know how the different components works internally, but only how to 
interface with them. 


2. Encapsulation—refers to wrapping up of data and function (that 
operate on the data) into a single unit called class. 


3. Modularity—is the property of a system that has been decomposed 
into a set of cohesive and loosely coupled modules. 


4. Inheritance—is the capability of one class of thing to inherit capabili- 
ties of properties from another class. Members are often specified as 
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public, protected or private, determining whether they are available 
to all classes, sub-classes or only the defining class. 


5. Polymorphism—is the ability for a message or data to be processsed 
in more than one form. Polymorphism is a property by which the same 
message can be sent to objects of several different classes. 

Data Types 


Fundamental data types: When programming, we store the variables in our 
computer’s memory, but the computer has to know what kind of data we 
want to store in them, since it is not going to occupy the same amount of 
memory to store a simple number than to store a single letter or a large 
number, and they are not going to be interpreted the same way. 


The memory in our computers is organized in bytes. A byte is the mini- 
mum amount of memory that we can manage in C++. A byte can store a 
relatively small amount of data: one single character or a small integer (gen- 
erally an integer between 0 and 255). In addition, the computer can ma- 
nipulate more complex data types that come from grouping several bytes, 
such as long numbers or non-integer numbers. 


Next you have a summary of the basic fundamental data types in C++, 
as well as the range of values that can be represented with each one: 


Name Description Size* Range* 
char Character or small integer | 1 byte signed: — 128 to 127 
unsigned: 0 to 255 
short int | Short Integer 2 bytes | signed: — 32768 to 32767 
(short) unsigned: 0 to 65535 
int Integer 4 bytes | signed: — 2147483648 to 
2147483647 
unsigned: 0 to 4294967265 
long int Long integer 4 bytes | signed: 2147483648 to 
(long) 2147483647 
unsigned: 0 to 4294967295 
bool Boolean value. It can take | 1 byte true or false 


one of two values: true or 
false 


float Floating point number Abytes | +/-3.4e + /— 38 (~ 7 digits) 
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Name Description Size* Range* 
double Double precision floating |8 bytes | +/—1.7e + /— 308 (~ 15 
point number digits) 
long dou- | Long double precision Sbytes | +/—1.7e + /- 308 (~ 15 
ble floating point number digits) 
wehar_t Wide character 2or4 1 wide character 
bytes 


Integer Type: Integers are whole numbers with a machine dependent range 
of values. A good programming language as to support the programmer by 
giving a control on a range of numbers and storage space. C++ has three 
classes of integer storage namely short int, int and long int. All of these data 
types have signed and unsigned forms. A short int requires half the space 
than normal integer values. Unsigned numbers are always positive and con- 
sume all the bits for the magnitude of the number. The long and unsigned 
integers are used to declare a longer range of values. 


Floating Point Types: Floating point number represents a real number with 
six digits precision. Floating point numbers are denoted by the keywords 
float. When the accuracy of the floating point number is insufficient, we can 
use the double to define the number. The double is same as float but with 
longer precision. To extend the precision further we can use long double 
which consumes 80 bits of memory space. 


Void Type: Using void data type, we can specify the type of a function. It 
is a good practice to avoid functions that does not return any values to the 
calling function. 


Character Type: A single character can be defined as a defined character 
type of data. Characters are usually stored in 8 bits of internal storage. The 
qualifier signed or unsigned can be explicitly applied to char. While un- 
signed characters have values between 0 and 255, signed characters have 
values from — 128 to 127. 


User defined type declaration: In C++ language a user can define an identi- 
fier that represents an existing data type. The user defined datatype identi- 
fier can later be used to declare variables. The general syntax is 


typedef type identifier; 
here type represents existing data type and “identifier” refers to the “raw” 
name given to the data type. 
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Example 


typedef int salary; 

typedef float average; 

Here salary symbolizes int and average symbolizes float. They can be later 
used to declare variables as follows: 

Salary deptl, dept2; 

Average sectionl, section2; 

Therefore deptl and dept2 are indirectly declared as integer datatype and 
section | and section 2 are indirectly float data type. 


Declaration of Storage Class: Variables in C++ have not only the data 
type but also storage classes that provides information about their location 
and visibility. The storage class divides the portion of the program within 
which the variables are recognized. 


auto: It is local variable known only to the function in which it is declared. 
Auto is the default storage class. 


static: Local variable which exists and retains its value even after the con- 
trol is transferred to the called function. 


extern: Global variable known to all functions in the file 
register: Social variables which are stored in the register. 


Defining Symbolic Constants: A symbolic constant value can be defined 
as a preprocessor statement and used in the program as any other constant 
value. The general form of a symbolic constant is 


# define symbolic name value of constant 
Valid examples of constant definitions are: 


# define marks 100 
# define total 50 
# define pi 3.14159 
These values may appear anywhere in the program, but must come 
before it is referenced in the program. 


It is a standard practice to place them at the beginning of the program. 
Declaring Variable as Constant 


The values of some variable may be required to remain constant through- 
out the program. We can do this by using the qualifier const at the time of 
initialization. 
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Example: 


Const int class size = 40; 
The const data type qualifier tells the compiler that the value of the int 
variable class_size may not be modified in the program. 


Derived Data Types: The C++ programming language allows program- 
mers to separate program-specific datatypes through the use of classes. 
Instances of these datatypes are known as objects and can contain member 
variables, constants, member functions, and overloaded operators defined 
by the programmer. Syntactically, classes are extensions of the C struct, 
which cannot contain functions or overloaded operators. 


Differences between struct in C and classes in C++: In C++, a struc- 
ture is a class defined with the struct keyword. Its members are by de- 
fault public. A class defined with the class keyword has by default private 


members. 


C++ classes have their own members. These members include variables 
(including other structures and classes), functions (specific identifiers or 
overloaded operators) known as method, construtors and destructors. 
Members are declared to be either publicly or privately accessible using 
the public: and private: access specifiers respectively. Any member 
encountered after a specifier will have the associated access until another 
specifier is encountered. There is also inheritance between classes which 
can make use of the protected: specifier. 


#include<iostream.h> 

#include<stdio.h> 

class play 

{ 
int playcode; 
char playtitle [25]; 
float duration; 
int noofscenes; 

public: 

play () 

{ 
duration=45; 
noofscenes=5; 

} 

void newplay() 


{ 
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cout<<"\n enter the play code"; 
cin>>playcode; 
cout<<"\n enter the play title"; 
gets (playtitle); 

} 


void moreinfo(float a,int b) 


duration=a; 
noofscenes=b; 


void showplay() 
cout<<playcode<<playtitle<<duration<<noofscenes; 


}; 
PROGRAMS OF STANDARD METHODS IN C++ LANGUAGE 


15.3 Bisection Method (Section 2.7) 


Flow-chart 
Refer to Section 14.3, page 674 
Program 


/* Bisection Method */ 
#include <iostream.h> 
#include <iomanip.h> 
#include <math.h> 

float f(float x) 

{ 

return (x*x*x - 4*x - 9); 
} 
void bisect (float *x,float a,float b,int *itr) 
{ 

*x = (a + b)/2; 


+A (ALER) 7 
cout << "Iteration no." <<setw(3) << *itr 
<< "X = " << setw(7) << setprecision(5) 


<< *x << endl; 


} 


int main() 


{ 
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int itr = 0, maxitr; 
float x, a, b, aerr, xl; 


cout << "Enter the values of a,b," 
<< "allowed error, maximum iterations" << endl; 
cin >> a >> b >> aerr >> maxitr; 
cout << fixed; 
bisect (&&,a,b,&itr); 
do 
{ 
if (f(a)*f(x) < 0) 


else 
a= xX; 
bisect (&xl,a,b,&itr); 
if (fabs(xl-x) < aerr) 
{ 
cout << "After" << itr << "iterations, root" 
<< "=" << setw(6) << setprecision (4) 
<< xl << endl; 


return 0; 


x = xl; 
} while (itr < maxitr); 
cout << "Solution does not converge," 

<< "iterations not sufficient" << endl; 
return 1; 


} 

NOTES: a, b are the limits in which the root lies 

aerr is the allowed error 

itr is a counter which keeps track of the number of iterations performed 


maxitr is the maximum number of iterations to be performed 
x is the value of root at nth iteration 

x1 is the value of root at (n + 1)th iteration. 

Function Bisect: 

Purpose: Performs and prints the result of one iteration 
Variables: x is the result of the current iteration. 


Computer Solution of Example 2.15 (a) 


Enter the values of a, b, allowed error, maximum iterations 
3 2.0001 20 
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Iteration No. 1 X = 2.50000 
Iteration No. 2 X = 2.75000 
Iteration No. 3 X = 2.62500 
Iteration No. 4 X = 2.68750 
Iteration No. 5 X = 2.71875 
Iteration No. 6 X = 2.70313 
Iteration No. 7 X = 2.71094 
Iteration No. 8 X = 2.70703 
Iteration No. 9 X = 2.70508 
Iteration No.10 X = 2.70605 
Iteration No.11 X = 2.70654 
Iteration No.12 X = 2.70630 
Iteration No.13 X = 2.70642 
Iteration No.14 X = 2.70648 
After 14 iterations, root = 2.7065 


15.4 Regula-Falsi Method (Section 2.8) 


Flow-chart 
Refer to Section 14.4, page 676 
Program 


/* Regula Falsi Method */ 
#include <isostream.h> 
#include <iomanip.h> 
#include <math.h> 
float f(float x) 
{ 
return cos (x) -x*exp (x); 
} 
void regula (float *x, float x0, float xl, 
float f£x0, float fxl, int *itr) 
i 
*x = x0-((x1-x0) / (£x1-f£x0) ) *£x0; 
+4( FLEE); 
cout << "Iteration no." << setw(3) << *itr 
<< "X = " << setw(7) << setprecision(5) 
<< *X << endl; 
} 
int main () 


{ 
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int itr=0, maxitr; 
float x0,x1,x2,x3,aerr; 


cout << "Enter the values for x0,x1," 
<< "allowed error,maximum iterations" << endl; 
cin >> x0 >> xl >> aerr >> maxitr; 
regula (&x2,x0,x1,f(x0),f£(x1),&itr); 
cout << fixed; 
do 
{ 
if (£(x0)*f(x2) < 0) 
xl = x2; 


x0 = x2; 
regula (&x3,x0,x1,f(x0),f£(x1),&itr); 
if (fabs (x3-x2) < aerr) 
{ 
cout << "After" << itr << "iterations," 
<< "root = " << setw(6) << setprecision (4) 
<< x3 << endl; 
return 0; 
} 
x2=x3; 
} while(itr < maxitr); 
cout << "Solution does not converge," 
<< "iterations not sufficient" << endl; 
return 1; 


} 


Notes: f(x) = 0 is the equation whose root is to be found 
x0, x1 are units in which root lies 

aerr is allowed error 

maxitr is maximum number of iterations to be performed 
itr is a counter which keeps track of the number of iterations performed 
x2 is value of root at nth iteration 

x3 is value of root at (n + 1)th iteration 

Function Regula: 

Purpose: Performs and prints the results of one iteration. 
Variables: x is value of root at nth iteration 

fx0, fxl are values of f(x) at x0 and x, 1 respectively. 


780 © Numerical METHODS IN ENGINEERING AND SCIENCE 


Computer Solution of Example 2.20 


Enter the values for x0, xl, allowed error, maximum iterations 
0 1.0001 20 


Iteration No. 1 X = 0.31467 
Iteration No. 2 X = 0.44673 
Iteration No. 3 X = 0.49402 
Iteration No. 4 X = 0.50995 
Iteration No. 5 X = 0.51520 
Iteration No. 6 X = 0.51692 
Iteration No. 7 X = 0.51748 
Iteration No. 8 X = 0.51767 
Iteration No. 9 X = 0.51773 


After 9 iterations, root = 0.5177 


15.5 Newton Raphson Method (Section 2.11) 


Flow-chart 
Refer to Section 14.5, page 679 
Program 


/* Newton Raphson Method */ 
#include <iostream.h> 
#include <iomanip.h> 
#include <math.h> 

float f(float x) 

{ 

return x*logl10 (x)-1.2; 

} 

float df(float x) 

{ 

return logl0(x) + 0.43429; 
} 
int main() 

{ 

int itr,maxitr; 

float h,x0,xl,aerr; 


cout << "Enter x0,allowed error," 

<< "maximum iterations" << endl; 
cin >> x0 >> aerr >> maxitr; 
cout << fixed; 
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for (itr=1;itr<=maxitr;itr+t) 


{ 


h = £(x0)/df£ (x0); 


xl = x0-h; 


cout << "Iteration no." << setw(3) << itr 
<< "X = " << setw(9) << setprecision (6) 


<< xl << endl; 
if (fabs(h) < aerr) 


{ 


cout << "After" << setw(3) << itr 
<< "iterations, root =" 


<< setw(8) 


return 0; 


<< setprecision(6) << xl; 


cout << "Iterations not sufficient," 


<< "solution does not converge" << endl; 


return 1; 


} 


aerr is allowed error 


Notes: F(x) = 0 is the equation whose root is to be found 
df(x) is the derivatives of f(x) w.r.t. x x0 is value of root of nth iteration 
x1 is value of root of (n + 1)th iteration 


maxitr is maximum no. of iterations to be performed 
itr is a counter which keeps track of the number of iterations performed. 


Computer Solution of Example 2.32 


2.000001 10 
Iteration No. 1 X 
Iteration No. 2 X = 
Iteration No. 3 X 
Iteration No. 4 X 
After 4 iterations, 


2 
2 
2 
2 


Enter x0, allowed error, maximum iterations 


813170 
741109 
- 740646 
. 740646 


root = 2.740646 


15.6 Muller’s Method (Section 2.13) 


Flow-chart 


Refer to Section 14.6, page 681 
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Program 


/* Muller's Method */ 
#include <iostream.h> 
#include <iomanip.h> 
#include <math.h> 
#define I 2 

float y(float x) 

{ 

return cos (x)-x*exp (x); 
} 

int main() 

{ 

int i,itr,maxitr; 

float x[4],1li,di,mu,s,1l,aerr; 


cout << "Enter the initial" 
"approximations" << endl; 
for (i = 1-2;1<3;i++) 
cin. >> x1] F 


cout << "Enter allowed error," 
"maximum iterations" << endl; 
Cin >> aerr >> maxitr; 
cout << fixed; 
for(itr = ljitr <= maxitr;itrt+t) 
{ 
a (x[2] =x [2=-1])/ (x [2-1] =x [1=-2]) 3 
di (x[I]-x[I-2]) /(x[I-1]-x[I-2]); 
mu = y(x[I-2])*li*li 
- y(x[I-1]) *di*di 
+ y(x[I])*(ditli); 


s = sqrt((mu*mu - 4*y(x[I])*di*li 
*(y (x[1=2]) *Li=y(x[1=1]) 
edi. + oy Geld] ))))3 


if (mu < 0) 


1 = (2*y(x[I])*di)/(-muts); 
else 
1 = (2*y(x[I])*di)/(-mu-s); 
x[I+1] = x[1I]+1*(x[I] - x[I-1]); 
cout << "Iteration no. " << setw(3) << itr 
<< "X = " << setw(7) << setprecision (5) 
<< x[I+1l1] << endl; 
if (fabs (x[I+1]-x[I]) < aerr) 
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cout << "After" << setw(3) << itr 
<< "iterations, the solution is" 


<< setw(6) 


<< x[I+1] 


return 0; 


for (i=1-2;i<3; 


<< setprecision (4) 


<< endl; 


it+) 


x[i] = x[it+l]; 


} 


cout << "Iterations not sufficient," 


<< "solution does not converge" << endl; 


return 1; 


} 


improved value 


liisd, 
di is 6, 


mu is Ll, 


lisa 


NOTES: y(x) = 0 is the equation whose root is to be found 
x is an array which holds the three approximations to the root and the new 


I is defined as 2 in the program. This has been done because in C, array 
subscripts always start from zero and cannot be negative. Use of I facili- 
tates more readable expressions. For e.g., x[0] can be written as «[I — 2] 
which looks more close to x, , it actually represents. 


sis Vipe- ay, OA,» A, ath 8) mS yi] 


Computer Solution of Example 2.34 


=1. 0:1 


-0001 10 
Iteration No. 1 X 
Iteration No. 2 XK = 
Iteration No. 3 X 
Iteration No. 4 X 
After 4 iterations, 


Enter allowed error, 


Enter the initial approximations 


maximum iterations 


-44152 
2OL255 
-51769 
.51776 
the solution is 0.5178 


oS 2 2 & 
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15.7 Multiplication of Matrices [Section 3.2 (3)4] 


Flow-chart 
Refer to Section 14.7, page 684 
Program 


/* Multiplication of matrices */ 
include <iostream.h> 

include < iomanip.h> 

include <math.h> 

define MAX 20 

typedef float matrix[MAX] [MAX]; 
void getelems (matrix x,int m,int n) 


int i,j; 
for (i=0; i<m; i++) 
for (j=0; i<m;itt+) 
cin >> x[il]l [jl]; 
} 
void printsol (matrix x,int m,int n) 
{ 
nS ou camer 
for (i=0;i<m;i+t+) 
{ 
for (j=0;j<n; j++) 
cout << setw(5) << setprecision (1) 
<< xfi] (jl; 
cout << endl; 
} 
} 
void matmul (matrix a,matrix b,matrix c, 
int 1, int m,int p, int q) 
{ 
float s; 
int i,3,k; 
cout << "Enter the elements of the" 
<< "first matrix" << endl; 
getelems(a,1l,m); 


cout << "Enter the elements of the" 
<< "second matrix" << endl; 


getelems (b,p,q); 
for (1=0;4:< lisa) 
for (j3=0;3<q; j++) 
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s = 0; 
for (k=0;k<m; k++) 
s += ali] [k] *b[k] [3]; 
clil(j] = si 
i 
cout << "The solution is" << endl; 
printsol(c,1,q); 
} 
int main () 
{ 
matrix a,b,c; 
int 1,m,p,q; 
cout << "Enter the row, column of the" 
<< "first matrix" << endl; 
cin >> 1 >> m; 


cout << "Enter the row, column of the" 
"second matrix" << endl; 
cin >> p >> q; 
cout << fixed; 
if (m!=p) 
{ 
cout << "The two matrices cannot" 
<< "be multiplied" << endl; 
return 1; 


} 


else 

{ 
matmul (a,b,c,1,m,p,q); 
return 0; 

} 

} 


Notes: MAX is largest number of rows or columns any matrix can have. 
(If MAX. = 20, 11 x 20, and 20 x 13 matrices can be multiplied but 1 x 
21, 22 x 1 matrices cannot be multiplied till MAX > = 22 

A, B are arrays which contain the matrices to be multiplied 

C is array which contains the result of multiplication 

L, M are respectively the rows, columns of first matrix 

P, Q are respectively the rows, columns of second matrix 

Function getelems 

Purpose: To input am x n matrix 


786 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


Function Matmul. 


Purpose: It performs the multiplication of matrices after taking them 
from the user and prints the result. 
Variables: i, j, k are loop control variables. 


Computer Solution of Example 3.7 


Enter the row, column of the first matrix 
3-3 

Enter the row, column of the second matrix 
3 2 

Enter the elements of the first matrix 


0 
1 
2 


Enter the elements of the second matrix 
1 -2 
=i 0 

2 =1 
The solution is 
3310) =2::-0 
50° =5...0 
7.0 -8.0 


15.8 Gauss Elimination Method [Section 3.4 (3)] 


Flow-chart 
Refer to Section 14.8, page 687 
Program 


/* Gauss elimination method */ 

#include <iostream.h> 

#include <iomanip.h> 

#include <math.h> 

#define N 4 

int main() 

{ 

float a[N] [N+1],x[N],t,s; 

int i,j,k; 

cout << "Enter the elements of the" 
"augmented matrix rowwise" << endl; 

cout << fixed; 
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for (i=0;1i<N;it++) 
for (j=0;3<N+1; j++) 
cin >> afi][jl); 


/* now printing the 

upper triangular matrix */ 

cout << "The upper triangular matrix" 
"is:-" << endl; 

for (i=0;i<N;i+t+) 


{ 


for (j3=0;3<N+1;j3++) 
cout << setw(8) << setprecision(4) << a[i][j]; 
cout << endl; 
} 
/* now performing back substitution */ 
for (i=N-1;1>=0;i--) 
{ 
s = 0; 
for (j=i+1;3<N;j++) 
s t= alil[j]*x[jl; 
x[i] = (alil([N]-s)/alil] fil; 
} 
/* now printing the results */ 
cout << "The solution is:- " << endl; 
for (i=0;i<N;i++) 
cout << "x[" << setw(3) << itl << "] =" 
<< setw(7) << setprecision(4) << x[i] << endl; 
return 0; 


} 


NOTES: N is the number of unknowns 

a is an array which holds the Augmented Matrix 

x is an array which will contain values of unknowns 
i, j, k are loop control variables. 


788 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


Computer Solution of Example 3.19 


10 = 3 | 6 
-6 8 -1 -4 ) 

3 1 4 11 2 

5 =o =2 4 7 
The upper triangular matrix is:- 
10.000 -7.0000 Bis 

0.0000 3.8000 0. 
-0.0000 -0.0000 2. 

0.0000 -0.0000 -0. 


The solution is:- 
X[ 1] = 5.0000 


X[ 2] = 4.0000 
X[ 3] = -7.0000 
X[ 4] = 1.0000 


15.9 Gauss-Jordan Method [Section 3.4 (4)] 


0000 
8000 
4474 
0000 


5.0000 
-1.0000 
10.3158 

9.9247 


Enter the elements of augmented matrix rowwise 


6.0000 
8.6000 
-6.8158 
9.9247 


Flow-chart 
Refer to Section 14.9, page 689 


Program 


/* Gauss jordan method */ 


#include <iostream.h> 


#include <iomanip.h> 
#define N 4 
int main() 


{ 


float a[N] [Nt+1],t; 
int i,j,k; 


cout << "Enter the elements of the" 


<< "augmented matrix rowwise" << endl; 


for (i=0;i<N;i++) 
for (j3=0;3<N+1;3++) 
cin >> al[i][jl; 


/* now calculating the values 


of x1,x2,....,xN */ 
cout << fixed; 
for (j3=0;j3<N;j++) 
for (i=0;i<N; i++) 
if (i!=j) 
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t = alil(jl]l/aljltil; 
for (k=0;k<N+1;k++) 
ali] [k] -= alj] ([k]*t; 
} 
/* now printing the diagonal matrix */ 
cout << "The diagonal matrix is:-" << endl; 
for (i=0;i<N; i++) 


{ 


for (j=0;3<N+1; j++) 
cout << setw(9) << setprecision(4) << a[i][j]; 
cout << endl; 
} 
/* now printing the results */ 
cout << "The solution is:- " << endl; 
for (i=0;i<N; i++) 
cout << "x[" << setw(3) << itl << "] =" 
<< setw(7) << setprecision (4) 
<< a[i][N]/a[i] [i] << endl; 
return 0; 


} 

NOTES: a is an array which holds the augmented matrix 

N is the number of unknowns. e¢.g., if it is a 3 x 3 system of equations, 
N = 3, and if 5 x 5 system take N = 5. 

i, j, k are loop variables. 


Computer Solution of Example 3.22 


Enter elements of augmented matrix rowwise 


10 -7 3 > 6 
-6 8 -1 -4 5 
3 1 4 11 2 
5 -9 -2 4 7 
The diagonal matrix is:- 
10.0000 -0.0000 -0.0000 -0.0000 50.0000 
0.0000 3.8000 -0.0000 0.0000 15.2000 
-0.0000 0.0000 2.4474 0.0000 -17.1316 
0.0000 -0.0000 0.0000 9.9247 9.9247 


The solution is:- 
X[ 1] = 5.0000 


X[ 2] = 4.0000 
X[ 3] = -7.0000 
X[ 4] = 1.0000 
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15.10 Factorization Method [Section 3.4 (5)] 


Flow-chart 
Refer to Section 14.10, page 691 


Program 


/* Factorization method */ 
#include <iostream.h> 
#include <iomanip.h> 
#define N 3 
typedef float matrix[N] [N]; 
matrix 1,u,a; 
float b[N],x[N],v[N]; 
void urow(int i) 
{ 
float s; 
int j,k; 
for (j=i;j<N;j++) 
{ 
s = 0; 
for (k=0;k<N-1;k++) 
s += ulk] [Jj] *1 [il] [kl]; 
ulil{j3] = alilljl-s; 
} 
} 
void lcol(int 3) 
{ 
float s; 
int i,k; 
for (i=j+1;1i<N;it++) 
{ 
s = 0; 
for (k=0;k<=j-1;k++) 
s += ul[k] [3] *1[i] [kl]; 
Lfil fg] = (alil(jl-s)/uljltil; 
} 
} 
void printmat (matrix x) 
{ 
DING ay yp 
for (i=0;i<N;it+) 


{ 
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for (j3=0;3<N; j++) 
cout << setw(8) << setprecision(4) << x[i] [4]; 
cout << endl; 
} 
} 
int main () 
{ 
ats a] My 
float s; 
cout << "Enter the elements of augmented" 


<< " matrix rowwise" << endl; 
for (i=0;i<N;it+t+) 
{ 
for (j3=0;3<N; j++) 
cin >> alilljl; 
cin >> b[i]; 
} 
cout << fixed; 
/* now calculating the elements of 1 and u */ 
for (i=0;1i<N;it++) 
1{ij][i] = 1.0; 
for (m=0;m<N;m++) 
{ 
urow(m); 
if (m < N-1) lcol(m); 
} 
/* now printing the elements of 1 and u */ 
cout << setw(14) << "U" << endl; printmat(u); 
cout << setw(14) << "L" << endl; printmat (1); 


/* now solving LV=B 
by forward substitution */ 
for (i=0;1i<N;i++) 


{ 


s = 0; 
(j=0; 3<=i-1;Jj++) 
s += 1[il(j]*vfjle 
v[i] = b[i]-s; 
} 

/* now solving UX=V 

by backward substitution */ 
for (i=N-1;1>=0;i--) 
{ 
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s = 0; 
for (j=it1;4<N;j++) 
s += u[i] [j]*x[3]; 
x[i] = (v[il-s)/ulil[il; 
} 
/* printing the results */ 
cout << "The solution is:-" << endl; 
for (i=0;i<N; i++) 
cout << "x[" << setw(3) << itl << "] 
<< setw(6) << setprecision (4) 
<< x[i] << endl; 
return 0; 


} 


" 


Notes: 

N is the no. of unknowns 

lis the lower triangular matrix 

u is the upper triangular matrix 

a is the coefficient matrix 

b is the constant matrix (Column matrix) 

v is a matrix such that lv = b 

x will contain the values of unknowns 

i, j, mare loop control variables 

Function urow (I) 

Purpose: Calculates elements of ith row of u 
Variables: m is the no. of unknowns 
j, k are loop control variables 

Function Lcol (J) 

Purpose: Calculates elements of jth column of | 
Variables: m is the no. of unknowns 

i, k are loop control variables. 

Function Printmat 

Purpose: To print an N x N matrix. 


Computer Solution of Example 3.23 


Enter the elements of augmented matrix rowwise 
3 2 7 +4 
2 3 1 5 
3 4 1 #7 
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U 
3.0000 2.0000 7.0000 
0.0000 1.6667 -3.6667 
0.0000 0.0000 -1.6000 


L 
1.0000 0.0000 0.0000 
0.6667 1.0000 0.0000 
1.0000 1.2000 1.0000 


The solution is: 
x[1] = 0.8750 
x[2] = 1.1250 
x[3] = - 0.1250 


Computer Solution of Example 3.24 


Enter the elements of augmented matrix rowwise 


10 -7 8 5 6 
=6 8 =1 -4 5 
3 1 4 11 2 
5 =9 -2 4 7 
U 
10.0000 -7.0000 3.0000 5.0000 
0.0000 3.8000 0.8000 -1.0000 
0.0000 0.0000 2.4474 10.3158 
0.0000 0.0000 0.0000 9.9247 
L 
1.0000 0.0000 0.0000 0.0000 
-0.6000 1.0000 0.0000 0.0000 
0.3000 0.8158 1.0000 0.0000 
0.5000 -1.4474 -0.9570 1.0000 


The solution is:- 
x[ 1] = 5.0000 


x[ 2] = 4.0000 
x[ 3] = -7.0000 
x[ 4] = 1.0000 


15.11 Gauss-Seidal Iteration Method [Section 3.5 (2)] 


Flow-chart 
Refer to Section 14.11, page 695 
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Program 


/* Gauss Seidal method */ 
#include <iostream.h> 
#include <iomanip.h> 
#include <math.h> 

#define N 3 int main() 

{ 
float a[N] [N+1],x[N],aerr,maxerr, t,s,err; 
int i,j,itr,maxitr; 

/* first initializing the array x */ 

for (i=0;1i<N;it+) x[i]=0; 

cout << "Enter the elements of the" 


<< "augmented matrix rowwise" << endl; 

for (i=0;i<N;itt) 

for (j=0;3<N+1; ++) 
cin >> a[i]l[jl; 

cout << 

<< "maximum iterations" << endl; 


"Enter the allowed error," 


cin >> aerr >> maxitr; 
cout << fixed; 
cout << "Iteration" << setw(6) << "x[1]" 
<< setw(11) << "x[2]" 
<< setw(11) << "x[3]" << endl; 
for (itr=1;itr<=maxitr;itrt+t) 
{ 
maxerr = 0; 
for (i=0;i<N; i++) 


{ 


s = 0; 
for (j3=0;3<N; j++) 

if (j!=i) s += alil(j]*x jl; 
t = (alil([N]-s)/alil[il; 
err = fabs(x[i]-t); 
if (err >> maxerr) maxerr = err; 
x[i] = t; 


} 
cout << setw(5) << itr; 
for (i=0;i<N; i++) 
cout << setw(1l1) << setprecision(4) << x[i]; 
cout << endl; 
if (maxerr << aerr) 
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cout << "Converges in" << setw(3) << itr 
<< "iterations" << endl; 
for (i=0;i<N;i+t+) 
cout << "x[" << setw(3) << itl << "] =" 
<< setw(7) << setprecision(4) << x[i] 
<< endl; 
return 0; 


} 
cout << "Solution does not converge," 

<< "iterations not sufficient" << endl; 
return 1; 


} 


NOTES: N is the number of unknowns 

a is an array which holds the augmented matrix 

x is an array which will hold the values of unknowns 

aerr is allowed error 

maxitr is the maximum no. of iterations to be performed 

itr is the counter which keeps track of no. of iterations performed 
err is error in value of xi 

maxerr is maximum error in any value of xi after an iteration. 


Computer Solution of Example 3.28 


Enter the elements of augmented matrix rowwise 


20 il -2 17 
3 20 = -18 
2 - 3 20 25 
Enter the allowed error, maximum iterations 
-0001 10 
Iteration X(1) X (2) X (3) 
1 0.8500 - 1.0275 1.0109 
2 1.0025 - 0.9998 0.9998 
3 1.0000 - 1.0000 1.0000 
4 1.0000 - 1.0000 1.0000 
Converges in 4 iterations 
X[1] = 1.0000 
X[2] = -1.0000 


X[3] 1.0000 
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Computer Solution of Example 3.30 


Enter the elements of the augmented matrix rowwise 


10 -2 -1 =I 3 
-2 10 -1 -1 15 
-1 -1 10 -2 27 
-1 -1 =2 10 -9 
Enter the allowed error, maximum iterations 
-0001 15 
Iteration x[1] x[2] x([3] x[4] 
iL 0.3000 1.5600 2.8860 -0.1368 
2 0.8869 1.9523 2.9566 -0.0248 
3 0.9836 1.9899 2.9924 -0.0042 
4 0.9968 1.9982 2.9987 -0.0008 
5 0.9994 1.9997 2.9998 -0.0001 
6 0.9999 1.9999 3.0000 -0.0000 
7 1.0000 2.0000 3.0000 -0.0000 
Converges in 7 iterations 
x[ 1] = 1.0000 
x[ 2] = 2.0000 
x[ 3] = 3.0000 
x[ 4] = 0.0000 


15.12 Power Method (Section 4.11) 


Flow-chart 
Refer to Section 4.12, page 699 


Program 


/* Power method for finding largest eigen value */ 
include <iostream.h> 

include <iomanip.h> 

include <math.h> 

define N 3 

typedef float array[N]; 

void findmax(float *max,array x) 


int i; 
*max = fabs(x[0]) 
for (i=1;i<N;it+) 
if (fabs(x[i]) 
*max = fabs(x[il); 


, 


> *max) 
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} 

int main () 

{ 

float a[N] [N],x[N],xr[N],maxe, 
rr,errv,aerr,e,s,t; 


int i,j,k,itr,maxitr; 


cout << "Enter the matrix rowwise" << endl; 
for (i=0;i<N; i++) 
for (j=0;3<N; j++) 
cin << a[i][jl; 
cout << "Enter the initial approximation" 
<< "to the eigen vector" << endl; 
for (i=0;i<N; i++) 
Cin >> x2] 


cout << "Enter the allowed error," 


<< "maximum iterations" << endl; 
cin >> aerr >> maxitr; 
cout << fixed; 
cout << "Itr no." << setw(11) << "Eigenvalue" 
<< setw(19) << "EigenVector" << endl; 
/*now finding the largest eigenvalue in 


the initial approx. to eigen vector */ 
findmax(&e,x); 
/* now starting the iterations */ 
for (itr=l;itr<=maxitr;itrt+t) 
{ 
/* loop to multiply the matrices a and x */ 
for (i=0;i<N; i++) 


for (k=0;k<N; k++) 
s += ali] [k]*x[k]; 
r[i]l=s; 
} 


findmax(&t,xr); 


for (i=O0;1<N;i++) r[i] /= t; 
maxe = 0; 
for (i=0;i<N;i++) 


{ 


err = fabs(x[i]-r[i]); 
if (err > maxe) maxe = err; 
x[i] = r[il; 
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errv = fabs (t-e); 
e=t; 
cout << setw(4) << itr 
<< setw(12) << setprecision (4) 
<< e; 
for (i=0;i<N; i++) 
cout << setw(9) << setprecision (3) 


<< x[il; 
cout << endl; 
if ((errv <= aerr) && (maxe <= aerr)) 


{ 
cout << "Converges in" << itr 
<< "iterations" << endl; 
cout << "Largest eigen value =" 


<< setw(6) << setprecision (2) 
<< e << endl; 
cout << "Eigen Vector:-" << endl; 
for (i=0;i<N; i++) 
cout << "x[" << setw(3) << itl << "J =" 
<< setw(6) << setprecision (2) 
<< x[i] << endl; 
cout << endl; 


cout << "Solution does not converge," 
<< "iterations not sufficient" << endl; 
return 1; 


} 


NOTES: N is number of rows (or columns) in square matrix 

a is the square matrix 

x is the eigenvector at nth iteration 

ris the eigenvector at (n + 1)th iteration 

e is the eigenvalue at nth iteration 

t is the eigenvalue at (n + 1)th iteration 

aerr is the allowed error in eigenvalue and eigenvector 
maxitr is the maximum number of iterations to be performed 
err is error in an element of the eigenvector 

maxe is the maximum error in any element of the eigenvector 
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errv is error in the eigenvalue 

itr, i, k are loop control variables. 

Function findmax: 

Purpose: Finds the maximum element in array x(a N-element array) and 
returns it in Max. 


Computer Solution of Example 4.11 


Enter the matrix rowwise 


2 -1 0 

-1 2 -1 

0) -1 2 

Enter the initial approximation to the eigen vector 

10 0 

Enter the allowed error, maximum iterations 

.O1 10 

Itr No. Eigen Value Eigen Vector 

1 2.0000 1.000 -0.500 0.000 
2 2.5000 1.000 -0.800 0.200 
3 2.8000 1.000 -1.000 0.429 
4 3.4286 0.875 -1.000 0.542 
5 3.4167 0.805 -1.000 0.610 
6 3.4146 0.764 -1.000 0.650 
7 3.4143 0.741 -1.000 0.674 
8 3.4142 0.727 -1.000 0.688 
9 3.4142 0.719 -1.000 0.696 

Converges in 9 iterations 

Largest eigen value = 3.41 

Eigen Vector:- 

X[1] = 0.72 

X[2] = -1.00 

X[3] = 0.70 


15.13 Method of Least Squares (Section 5.5) 


Flow-chart 
Refer to Section 4.13, page 703 
Program 


/* Parabolic fit by least squares */ 
#include <iostream.h> 

#include <iomanip.h> 

int main () 
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float augm[3] [4]={{0,0,0,0},{0,0,0,0},{0,0,0,0}}; 
float t,a,b,c,x,y,xsq; 
Mt dy yp Ky NG 


cout << "Enter the no. of pairs of" 
<<"observed values:" << endl; 

cin >> ne? 

cout << fixed; 

augm [0] [0] = n; 

for (i=0;i<n;it+) 


{ 


cout << "Pair no. " << itl << endl; 
cin >> x >> y; 
XSQ = X*X; 
augm[0O] [1] += x; 
augm[0][2] += xsq; 
augm[1][2] += x*xsq; 
augm[2][2] += xsq*xsq; 
augm[0][3] += y; 
augm[1][3] += x*y; 
augm[2][3] += xsq*y; 
} 
augm[1][1] = augm[0] [2]; 
augm[2][1] = augm[1] [2]; 
augm[1][0] = augm[0] [1]; 
augm[2][0] = augm[1] [1]; 
cout << "The augmented matrix is:-" << endl; 


for (i=0;1<3;i++) 
{ 
for (j=0;3<4; j++) 
cout << setw(9) << setprecision (4) << augm[i][j]; 
cout << endl; 
} 
/* Now solving for a,b,c 
by Gauss Jordan Method */ 
for (43=0;4<3; 3++) 
for (i=0;i<3;i+t+) 
if (i!=3) 
{ 
t = augm[i] [j]/augm[j] [3]; 
for (k=0;k<4;k++) 
augm[i] [k] -= augm[j] [k] *t; 
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} 
a augm[0] [3]/augm[0] [0] 
b augm[1] [3]/augm[1] [1]; 
c = augm[2][3]/augm[2] [2]; 
cout << setprecision (4) 


, 


<< "a = " << setw(8) << a 
<< "b=" << setw(8) << b 
<< "c =" << setw(8) << c 
<< endl; 


return 0; 


} 


Notes: augm is the augmented matrix. 
n is the number of data points. 


Computer Solution of Example 5.7 


Enter the no. of pairs of observed values: 
7 

Pair No. 1 

i! ape 

Pair No. 2 

1.3: - Le. 

Pair No. 3 

21.6 

Pair No. 4 

2.5 2 

Pair No. 5 

S310! 267 

Pair No. 6 

3.5 3.4 

Pair No. 7 

4.0 4.1 

The augmented matrix is:- 

7.0000 17.5000 50.7500 16.2000 
17.5000 50.7500 161.8750 47.6500 
50.7500 161.8750 548.1875 154.4750 

a = 1.0357 b = -0.1929 c= 0.2429 


15.14 Method of Group Averages (Section 5.9) 


Flow-chart 
Refer to Section 14.14, page 706 
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Program 


#include<iostream.h> 

#include<conio.h> 

#include<iomanp.h> 

void main () 

{ 

int t[10],n,i,ts1=0,ts2=0; 

float a,b,rsl=0,rs2=0,r[10],x1,yl,x2,y2; 

clrecr ()+ 

cout<<"enter the no. of observations"<<endl; 

cin>>n; 

cout<<"enter the different values of t"<<endl; 
for (i=1; i<=n;it+) 


{ 


cin>>t 


} 


cout<<' 


for (i=1 


{ 
cin>>r 
} 
for(i 
{ 
tsl14 
rsl4 
} 
for(i 
{ 
ts2t+= 
rs2d 


} 


t=—7 


xl=ts1/ 
yl=rsi/ 
x2=ts2/ 
y2=rs2/ (n/2 


il; 


"\nenter th 
ji<=n;it++) 


corresponding values of r"<<endl; 


il; 


1;i<=(n/2);it+) 


i]; 
il; 


((n/2)+1);i<=n; itt) 


Lil; 


, 


n/2 
n/2 
n/2 


, 


, 


( ) 
( ) 
( ) 
) 


, 


b=(y2-yl1) /(x2-x1) ; 
a=yl-(b*x1); 


cout<<"the value of a&b comes out to be 
"<<endl<<"a="<<setw(5)<<setprecision (3) <<a<<"\n"<<"b="<< 
setw(5) <<setprecision (3) <<b; 

getch (); 

} 
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Computer Solution of Example 5.16 


Enter the no. of observations 

8 

nter the different values of t 

40 50 60 70 80 90 100 110 

nter the corresponding values of r 

1069.1 1063.6 1058.2 1052.7 1049.3 1041.8 1036.3 1030.8 
the value of a&b comes out to be 

a=1090.256 

b=-0.534 


15.15 Method of Moments (Section 5.11) 


Flow-chart 
Refer to Section 14.15, page 708 
Program 


#include<iostream.h> 

#include<conio.h> 

#include<iomanip.h> 

void main() 

{ 

int x[10],y[10],i,n, yt=0,xlyt=0; 

float a,b,11,12,cl1,c2,c3,d,d1,d2,m1,m2,h; 
clrscr () 3 

cout<<"enter the no. of observations"<<endl; 
cin>one 

cout<<"enter the different values of x"<<endl; 
for (i=1;i<=n;it+) 

{ 
cin>>x[i]; 
} 


cout<<"\nenter the corresponding values of y"<<endl; 


for (i=1; i<=n;it+) 
{ 
cin>>y[i]; 
} 
h=x[2]-x[1]; 

for (i=1; i<=n;it+) 
{ 

ytt=ylil; 
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xlytt=x[i]*ylil; 

} 

ml=h*yt; 

m2=h*xlyt; 
11=(-(h/2)+x[1]); 
12=((h/2)+x[n]); 
cl=(12-11); 
e2=((12*12)-(11*11) /2); 


c3=((12*12*12) -(11*11*11*) /3); 

cout<<"The observed equations 
are"<<endl<<cl<<"a+t"<<c2<<"b"<<end1<<"&"<<c2<<"at"<<c3<<"b"; 

d=c2/cl; 

dl=d*cl; 

d2=d*c2; 

ml=d*m1; 

b=(m2-m1) / (c3-d2) ; 

a=(m1-(d2*b)) /d1; 

cout<<"\nOn solving these equations we get 
a=""<<setw (5) <<setprecision (2) <<a<<" 
&b="<<setw (5) <<setprecision (2) <<b<<endl; 

cout<<"hence the required equation is 
y=""<<setw (5) <<setprecision (2) <<a<<"+"<< 
setw(5)<<setprecision (2) <<b<<"x"; 

getch (); 

} 


Solution of Example 5.20 


Enter the no. of observations 


4 

nter the different values of x 

PT 23a 

nter the corresponding values of y 
16 19 23 26 


the observed equations are 

4.00a+10.00b=84.00 

&10.00a+30.33b=227.00 

on solving these equations we get a=13.03&b=3.19 


hence the required equation is y=13.03+3.19x 
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15.16 Newton’s Forward Interpolation Formula (Section 7.2) 


Flow-chart 
Refer to Section 4.16, page 711 
Program 


/* Newton's forward interpolation */ 

#include <iostream.h> 

#include <iomanip.h> 

#define MAXN 100 

#define ORDER 4 int main() 

{ 

float ax[MAXN+1],ay[MAXN+1], 
diff [MAXN+1] [ORDER+1], 
nr=1.0,dr=1.0,x,p,h,yp; 


int n,i,j,k; 
cout << "Enter the value of n" << endl; 
cin SS ng 


cout << 
for (i=0;i<=n;i++) 
cin >> ax[i] >> ayl[il]; 


‘Enter the values in form x,y" << endl; 


cout << "Enter the values of x" 


<< "for which value of y is wanted" << endl; 
cin >> x: 


cout << fixed; 
h=ax[1]-ax[0]; 
/* now making the diff. table */ 
/* calculating the lst order differences */ 
for (i=0;i<=n-1; i++) 
diff[i][1] = ay[itl]-ay[il; 
/* calculating the second & higher order differences.*/ 
for (j=2;3<=ORDER; j++) 
for (i=0;i<=n-j;i++) 
diff [i] [3] = diff[itl] [5-1] 
-diff[il[j-1l; 
/* now finding x0 */ 


i=0; 

while (!(ax[i] > x)) itt; 

/* now ax[i] is x0 & ay[i] is yO */ 
157 

p = (x-ax[i])/h; yp=ay[i]; 

/* Now carrying out interpolation */ 
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for (k=1;k<=ORDER; k++) 

{ 

nr *= p-kt+l; dr *=k; 

yp += (nr/dr) *diff[i] [k]; 

} 

cout << "When x = " 
<< setw(6) << setprecision(1) 
<< Xx 
<< "yo" 


<< setw(6) << setprecision (2) 
<< yp << endl; 
return 0; 


} 


NOTES: MAXN is the maximum value of N 

ORDER is the maximum order in the difference table 
ax is an array containing values of x (x0, «1......., x) 

ay is an array containing values of y(y9, y1......, yn) 
diff is a 2D Array containing the difference table 

h is spacing between values of X 

x is value of x at which value of y is wanted 

yp is calculated value of Y 

nr is numerator of the terms in expansion of yP 

dr is denominator of the terms in expansion of yP. 


Computer Solution of Example 7.1 


Enter the value of n 

6 

Enter the values in form x, y 
100 10.63 

150 13.03 

200 15.04 

250 16.81 

300 18.42 

350 19.90 

400 21.27 

Enter the values of x for which value of y is wanted 
218 

When x = 218.0, y = 15.70 
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15.17 _Lagrange’s Interpolation Formula (Section 7.12) 


Flow-chart 
Refer to Section 4.17, page 714 
Program 


/*Lagrange's Interpolation*/ 
#include <iostream.h> 
#include <<iomanip.h> 
#define MAX 100 int main() 

{ 


float ax [MAX+1],ay[MAX+1],nr,dr,x, y=0; 


int 1, j,i? 


cout << "Enter the value of n" << 
cin >> ny 
cout << "Enter the set of values" 
for (i=0;i<=n;i++) 

cin >> ax[i] >> ayl[il]; 
cout << "Enter the value of x for 

<< "value of y is wanted" << 

cin S> x: 
cout << fixed; 
for (i=0;i<=n;i++) 
{ 

nr=dr=1; 


for (j=0; j<=n; j++) 
if (j!=1) 
{ 
nr *= x-ax[j]; 
dr *= ax[i]-ax[j]; 
y t= (nr/dr)*ay[il; 
"When x=" 
setw (4) 
x << "ys" 
setw (7) 
y << endl; 
return 0; 


} 


<< 


<< setprecision (1) 


<< setprecision (1) 


endl; 


<< endl; 


which" 
endl; 
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NOTES: MAX is the maximum value of n 

ax is an array containing values of x(x,, x,,....., X,) 
ay is an array containing values of y(y,, y,,...- Y,) 
x is the value of x at which value of y is wanted 

y is the calculated value of y 

nr is numerator of the terms in expansion of y 

dr is denominator of the terms in expansion of y. 


Computer Solution of Example 7.17 


Enter the value of n 
4 
Enter the set of values 

5 150 

7 392 

11 1452 

13 2366 

17 5202 

Enter the value of x for which value of y is wanted 
9 

When x = 9.0 y = 810.0 


15.18 Newton’s Divided Difference Formula (Section 7.14) 


Flow-chart 
Refer to Section 14.18, page 716 
Program 


#include<iostream.h> 

#include<conio.h> 

void main () 

{ 

int x[10],y[10],p[10]; 

int k,f,n,i,j=1,f1=1, £2=0; 

clrecr() + 

cout<<"enter the no. of observations\n"; 
cin>>n; 

cout<<"enter the different values of x\n"; 
for (i=1;i<=n; i++) 

{ 

cin>>x[i]; 

} 


cout<<"enter the corresponding values of y\n"; 
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for (i=1;i<=n;i++) 
{ 
cin>>y[i]; 
} 
f=y[1]; 
cout<<"enter the value of 'k' in f(k) you want to evaluate\n"; 
cin>>k; 
do 
{ 
for (i=1;i<=n-1;i++) 
{ 
pliJ=((y (4+1)-ylil)/(x[itj]-x[1il])); 
ylijJ=plil; 
} 
for (i=1;i<=j;i++) 
{ 
f1*=(k-x[i]); 
} f2+=(y[1]*f1); £1=1; 
n--; 
j++; 
} while(n!=1); f£+=f£2; cout<<"f ("<<k<<")="<<f; getch(); 
} 


Computer Solution of Example 7.23 


Enter the no. of observations 


r the different values of x 
13 17 


Tp 
Bn 


5 


~I ct 
bh 
bh 


nter the corresponding values of y 

150 392 1452 2366 5202 

nter the value of 'k' in f(k) you want to evaluate 
9 £(9)=810 


15.19 Derivatives Using Forward Difference Formulae 
(Section 8.2) 


Flow-chart 
Refer to Section 14.19, page 718 
Program 


/* derivatives using forward difference*/ 
#include<iostream.h> 
#include<math.h> 
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#include<iomanip.h> 
#include<conio.h> 
void main( ) 
{ 
float *x=NULL, *y=NULL,max; 
float *tmp = NULL; 
float xval,h,p,x0,y0, yval,sum; 
int pos,i; 
clrecr\, )? 
cout<<"enter the no of comparisons"; 
cin>>max; 
x=new float [max]; 
y=new float [max]; 
cout<<"enter the values in cv table for x and y"; 


for (i=0;i<max;it+t) 

{ 
cout<<"\n value for "<<i<<"x" 
Cin>>x[i]; 
cout<<"\n value for "<<i<<"y" 
cin>>yl[i]; 

} 


cout<<"enter the value of x"; 


cin>>xval; 
for (i=0;i<max;i+t+) 
{ 
if (x[i]>=xval) 
{ 
pos=i; 
break; 


} 

x0=x[pos]; 

y0O=y[pos]; 

cout<<"\nx0 is "<<x0<<"y0 is "<<y0<<"at"<<pos; 
h=x[1]-x[0]; 

p=(xval-x0) /h; 

if (pos< (max) ) 

{ 

ant dy 193 

// calculating no of elements in array 
l=max-pos; 

tmp= new float [1* 1]; 
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cout<<"\n"; 
for (i=0;i<1;i++) 
{ 

for (j=0; j<=1; j++) 

{ 

tmp [i*1+j]=0; 

} 

cout<<"\n"; 
} 
cout<<"\n size of new array" <<l<<"\n"; 
//copying values of y in array 
for(i=0, j=pos;i<l;it+, j++) 
{ 

tmp[i]=y[j]; 
} 
cout<<"\n"; 
for (i=1;i<1;i++) 
{ 

for(j=0; j<l-i; j++) 

{ 

tmp [i*1+j]=tmp[ (i-1) *1+(j+1) J-tmp[ (i-1)*1+(3) 15 


} 
cout<<"\nvalues are \n"; 
for (i=0;i<1;i++) 
{ cout<<x [itpos]<<"\t"; 
for(j=0; j<l; jtt) 
{ 


cout<<setprecision (3) <<tmp[j*1+i]<<"\t|"; 
} 
cout<<"\n; 
} 
//appling newtons forward diffenation using first derivates 
sum=0; 
int k=1; 
for (i=1;i<1;i++) 
{ 
sum=sum+t ((1.0/i) *tmp[i*tmp[i*1+0]*k); 
k=-k; 
} 
cout<<"\n\n first (dy/dx): "<<sum/h; 
int v[]={0,0,1.0, 1.0, 11.0/12.0,5.0/6.0,137.0/180.0}; 
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sum=0; 
k=1; 
for (i1=2;i<1;i++) 
{ 
sum=sum+ (v[i] *tmp [i*1+0]*k); 
k=-k; 
} 
cout<<"\n\n second (dy/dx): "<<sum/pow(h,2.0); 
} 


Computer Solution of Example 8.1 


value for 0x1.0 
value for 0Oy7.989 
value for 1x1.1 
value for 1y8.403 
value for 2x1.2 
value for 2y8.781 
value for 3x1.3 
value for 3y9.129 
value for 4x1.4 
value for 4y9.451 
value for 5x1.5 
value for 5y9.750 
value for 6x1.6 


value for 6y10.031 


Enter the value of x1l.1 
x0 is 1.ly0O is 8.403atl 


size of new array 6 


values are 


1.18.403 |0.378 |-0.03 |0.004 |-0.001 |0.003 
1.28.781 |0.348 |-0.026 10.003 |0.002 |0 | 
1.39.129 |0.322 |-0.023 |0.005 |0 |0 | 
1.49.451 |0.299 |-0.018 |0 |0 |0 | 
1.59.75 [0.281 |0 |0 |0 |0 | 
1.610.031 |0 |0 [0 [0 10 | 


First (dy/dx): 3.952 


second (dy/dx): -3.74 
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15.20 Trapezoidal Rule (Section 8.5—l) 


Flow-chart 
Refer to Section 14.20, page 724 
Program 


/* Trapezoidal rule.*/ 
#include <iostream.h> 
#include <iomanip.h> 
float y(float x) 

{ 

return 1/ (1+x*x); 

} 

int main () 

{ 

float x0,xn,h,s; 

int i,;n; 


cout << "Enter x0,xn,no. of subintervals" << endl; 


cin >> x0 >> xn >> n; 

cout << fixed; 

h = (xn-x0) /n; 

s = y(x0)+y(xn); 

for (i=1;i<=n-1;i++) 

s += 2*y(x0t+i*h); 

cout << "Value of integral is" 
<< setw(6) << setprecision (4) 
<< (h/2)*s << endl; 

return 0; 


} 


NOTES: y/(x) is the function to be integrated 
x0 is xO 


xN is xn. 


Computer Solution of Example 8.10 (i) 


Enter x0, xn, no. of subintervals 
0 6 6 
Value of integral is 1.4108 
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15.21 Simpson’s Rule (Section 8.5—II) 


Flow-chart 
Refer to Section 14.21, page 726 
Program 


/* Simpson's rule */ 
#include <iostream.h> 
#include <iomanip.h> 
float y(float x) 

{ 

return 1/(1+x*x); 

} 
int main() 

{ 

float x0,xn,h,s; 
int i,n; 


cout << "Enter x0,xn, no.of subintervals" 
<< endl; 

cin >> x0 S> xn >> ny 

cout << fixed; 

h = (xn-x0)/n; 

s = y(x0)+y(xn)+4*y(x0th) ; 

for (i=3;i<=n-1;i+=2) 

s += 4*y(x0+i*h)+2*y (x0+(i-1) *h); 

cout << "Value of integral is" 
<< setw(6) << setprecision (4) 
<< (h/3)*s << endl; 

return 0; 


} 


NOTE: y(x) is the function to be integrated so that yi = y(xi) = y(x0 + i*h) 


Computer Solution of Example 8.10 (ii) 


Enter x0, xn, no. of subintervals 
0 6 6 
Value of integral is 1.3662 
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15.22 Euler’s Method (Section 10.4) 


Flow-chart 
(Refer to Section 14.22, page 727 
Program 


/*Euler's Method*/ 
#include <iostream.h> 


#include <iomanip.h> 
float df(float x,float y) 

{ 
return x+y? 

} 
int main () 

{ 

float x0,y0,h,x,x1,yl; 

cout << "Enter the values of x0,y0,h,x" << endl; 
cin >> x0 >> yO >> h >> x; 

cout << fixed; 

x1=x0;yl=y0; 

while (1) 
{ 


if (xl>x) return 0; 
yl += h*df(xl1,yl); 
xl += h; 

cout << "When x = " 


<< setw(3) << setprecision(1) 
<< xl << "yes" 

<< setw(4) << setprecision (2) 
<< yl << endl; 


NOTES: df(x, y) is dy/dx 
x0 is xn+0 i.e., «n 

Ho lmIsiocry-telk 

yO is yn+0i.e., yn 

yl is yn+1 


Computer Solution of Example 10.8 


Enter the values of x0, yO, h, x 
0: 2. 2 
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When x = 0.1 y = 1.10 
When x = 0.2 y = 1.22 
When x = 0.3 y = 1.36 
When x = 0.4 y = 1.53 
When x = 0.5 y= 1.72 
When x = 0.6 y = 1.94 
When x = 0.7 y = 2.20 
When x = 0.8 y = 2.49 
When x = 0.9 y = 2.82 
When x = 1.0 y = 3.19 


15.23 Modified Euler’s Method (Section 10.5) 


Flow-chart 
Refer to Section 14.23, page 729 


Program 


/* Modified Euler's Method*/ 
#include<iostream.h> 
#include<math.h> 
#include<iomanip.h> 


#include<conio.h> 

void main( ) 

{ 
clrscr ( ); 
int i,j; 
float x,y,x1=0.0,y1=0.0,h,ms=0.0, flag=0, y2=0.0,t=0.0; 
cout<<"\nenter the value of x"; 
Ccin>>x? 
cout<<"enter the value of y"; 
cin>>y; 
cout<<"enter the height"; 
cin>sh-s 


i=7; 

j=2; 

gotoxy(2,1); 

cout<<"x";gotoxy (10,1); cout<<"xty=yl";gotoxy (28,1); 
cout<<"mean slope"; gotoxy (45,1) ;cout<<"old y+.1(mean 
slope)new y"; while (xl<x) 

{ 


Tbh 
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itt; 

if (flag==0) 

{ 
yl=xlt+y; 
gotoxy (2,1); cout<<xl;gotoxy(10,i); 

cout<<yl;gotoxy (28,1) ;cout<<ms; 

ms=yl; 
y2=yth*ms; 
gotoxy (45,1) ;cout<<y2; 
xl=x1th; 
flag=1; 


else 


ms=(yl+(xl+y2))/2.0; 
t=yth*ms; 
if (y2==t) 


y2=yth*ms; 
break; 
} 
gotoxy (2,1); cout<<xl;gotoxy (10,1) ; cout<<x1<<"4+"<<x2; y2=yth*ms; 
gotoxy (28,1) ;cout<<ms;gotoxy (45,1) ;cout<<y2; 
} 
}while (1); 
y=y2; 
cout<<"\n"; 
flag=0; 
} 
getch( ); 
} 


Computer Solution of Example 10.10 


nter the value of x.3 
nter the value of yl 
enter the height.1 
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x xty=yl mean slope old y+.1(mean slope)new y 
0 a 0 1.1 

0.1 0.2 4 1.1 Lod Hee 

0.1 O.1 + 1.11 1.105 1.1105 
0.1 O.1 + 1.1105 1.10525 1.110525 
0.1 0.1 + 1.110525 1.105263 1.110526 
0.1 O.1 + 1.110526 1.105263 1.110526 
0.1 1.210526 1.105263 1.231579 
0.2 0.2 + 1.231579 1.321053 1.242632 
0.2 0.2 + 1.242632 1.326579 1.243184 
0.2 0.2 + 1.243184 1.326855 1.243212 
0.2 0.2 + 1.243212 1.326869 1.243213 
0.2 1.443213 1.32687 1.387535 
0.3 0.3 + 1.387535 1.565374 1.399751 
0.3 023 + 1.399751 1.571482 1.400362 
0.3 0.3 + 1.400362 1.571787 1.400392 
0.3 0.3 + 1.400392 1.571803 1.400394 


15.24 Runge-Kutta Method (Section 10.7) 


Flow-chart 
Refer to Section 14.24, page 732 
Program 


/* Runge Kutta Method */ 

#include <iostream.h> 

#include <iomanip.h> 

float f(float x,float y) 

{ 

return xty*y; 

} 

int main() 

{ 

float x0,y0,h,xn,x,y,k1l,k2,k3,k4,k; 

cout << "Enter the values of x0,y0," 
<< "h,xn" << endl; 

cin >> x0 >> yO >> h >> xn; 


x = xO; y = yO; 
cout << fixed; 
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while (1) 
{ 
if (x == xn) break; 
kl = h* f(x,y); 
k2 = h*f(xth/2,yt+k1/2) ; 
k3 = h*f£(xth/2,yt+k2/2); 
k4 h*£ (xth, y+k3) ; 
k = (k1+(k2+k3)*2+k4) /6; 
x += h; y += k; 
cout << "When x = " << setprecision(4)" 
<< setw(8) << x 
<< "y=" << setw(8) << y << endl; 


} 
return 0; 
} 
Notes: x0 is starting value of x i.e., x0 
an is the value of x for which y is to be determined. 


Computer Solution of Example 10.15 


Enter the values of x0, yO, h, xn 
020°1..0 0.2 0.22 

When x = 0.1000 y = 1.1165 

When x = 0.2000 y 1.2736 


15.25 Milne’s Method (Section 10.9) 


Flow-chart 
Refer to Section 14.25, page 734 
Program 


/*Milne predictor corrector*/ 
#include <iostream.h> 
#include <iomanip.h> 
#include <math.h> 
float x[5],y[5],h; 
float f(int i) 
{ 
return x[i]-y[il]l*ylil; 
} 
void corect () 


{ 
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yl4] = yl2]+(h/3)* (£(2)+4*£(3) +£(4)); 
cout << setw(23) << "™ 
<< setprecision (4) 
<< setw(8) << y[4] 
<< setw(8) << £(4) << endl; 
<< "",y[4],f(4) 
} 
int main() 
{ 
float xr,aerr,yc; 
int i; 
cout << "Enter the values of x0,xr,h," 
<< "allowed error" << endl; 
cin >> x[0] >> xr >> h >> aerr; 


cout << "Enter the value of y[i], i=0, 3" << endl; 


for (i=0;1i<=3;i+t+) cin >> ylil; 
cout << fixed; 
for (i=1;i<=3;i+t+) x[i] = x[0]+i*h; 


cout << setw(5) << "x" << setw(15) << "Predicted" 


<< setw(17) << "Corrected" << endl; 
cout << setw(11) << "y" << setw(10) << "f£" 
<< setw(7) << "y" << setw(10) << "f" << endl; 
while (1) 
{ 

if(x[3] = xr) return 0; 

x[4] = x[3] th; 

yl4] = y[0]+ 


(4*h/3) * (2* (£(1) +£(3))-£(2)); 


cout << setw(6) << setprecision(2) << x[4] 


<< setprecision (4) 
<< setw(8) << y[4] 
<< setw(8) << £(4) << endl; 
corect (1); 
while (1) 
{ 
ye = yl4]; 
corect (); 
if(fabs(yc-y[4]) <= aerr) break; 
} 
for (i=0;i<=3;1i++) 


{ 
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xn 


NOTE: x is an array such that x[i] represents xn+i for e.g., x[0] represent 


y is an array such that y[i] represents yn+i 

xr is the last value of x at which value of y is required 

h is spacing in values of x 

aerr is the allowed error in value of y yc is the latest corrected value for y 
f is the function which returns value of y’ 

corect is a subroutine that calculates the corrected value of y and prints it. 


Computer Solution of Example 10.19 


0 1.2.0001 
Enter values of y[il]; 
0.02.0795.1762 


Predicted 
xX y 
0.80 0.3049 
1.200 0.4554 


Enter the values of x0, xr, h, allowed error 


i= 0, 3 
Corrected 
£ y £ 
0.7070 
0.3046 0.7072 
0.3046 0.7072 
0.7926 
0.4556 O.7925 
0.4556 0.7925 


15.26 Adams-Bashforth Method 


Flow-chart 


Refer to Section 14.26, page 736 


/*Adams-Bashforth Method*/ 


include<iostream.h> 
include<stdio.h> 
include<malloc.h> 
include<math.h> 
include<conio.h> 


void main( ) 
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float *x, *y, *f; 

float h; 

int i,size, row; 

clirscr| )} 

cout <<"enter the size"; 
cin>>size; 


x=new float[sizet 


, 


, 


+1] 
y=new float[sizet1] 
f=new float[sizet+l]; 
for (i=0;i<size;itt) 


{ 


cout<<"enter the value for x["<<i<<"]"; 
Cin>>x[i]; 
cout<<"enter the value for y["<<i<<"]"; 
cin>>y[i]; 


h=x[1]-x[0]; 
// calculating values [f] 
for (i=0;1<4;1i++) 
{ 
f[i]=pow(x[i],2)*(1.0+y[i]); 
} 
cout<<"\nvalues for (x) (y) and (f) are\n"; 
row=16; 
for (1=0;i<4;i++) 
{ 
gotoxy (2, row) ; cout<<"x="; gotoxy (6, row) ; cout<<x[i];gotoxy(13,ro 
w) ; cout<<"y"<<i-3;gotoxy (16, row) ; cout<<"=";gotoxy (18, row) ; cout 
<<y[i];gotoxy (28, row) ; cout<<"f£"<<i-3; gotoxy (32, row) ; cout<<"="; 
gotoxy (35,row) ;cout<<f[ij; 
rowt++; 
} 


//using predicator 


y[size]J=y[size-1]+((h/24) * ((55*f[size-1])-(59*f[size- 
2])+(37*£[size- 
3])-(9*f[size-4]))); 


x[size]=1.4; 

f[size]=pow(x[size],2)*(1.0+y[size]); 

gotoxy (2, row) ; cout<<"x="; 
gotoxy (6, row) ; cout<<x [size] ;gotoxy (13, row) ;cout<<"yl1"; 
gotoxy(16,row) ; cout<<"="; gotoxy(18,row) ; cout<<y[size 
];gotoxy (28, row) ; cout<<"f1"; gotoxy (32, row) ; cout<<"="; 
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gotoxy (35, row) ; cout<<f [size]; 


} 


Computer Solution of Example 10.23 


nter the size 4 

nter the value for x[0]1.0 
nter the value for y[0]1.000 
nter the value for x[1]1.1 
nter the value for y[1]1.233 
nter the value for x[2]1.2 
nter the value for y[2]1.548 
nter the value for x[3]1.3 
nter the value for y[3]1.979 


values for 


x x xX Mm M 
ll 
PPRPRPP 
BONE 


(x) (y) and (f) are 


y-3 = 1 £-3 = 2 
y-2 = 1.233 £-2 = 2.70193 
y-1 = 1.548 f-1 = 3.66912 
yO = 1.979 £0 = 5.03451 

yl = 2.572297 fl = 7.001702 


15.27 Solution of Laplace’s Equation (Section 11.5) 


Flow-ch 
Refer to 


/* Laplace 


pm on ca ee 
cout << "J 
aera 


art 
Section 14.27, page 740 


"s Equation */ 


include <iostream.h> 

include <iomanip.h> 

include <math.h> 

define SOR 4 

typedef float array[SQR+1] [SQR+1]; 
void getrow(int i,array u) 


Enter the values of u[" 
<< ",j], j=1, " << SOR << endl; 


for (j=1;3<=SOR;j++) 


cin >> 


} 


ufil(jli 


void getcol(int j,array u) 
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{ 


int i; 


cout << "Enter the values of u[i," << j 
<< "J, 1=2," << SQR-1 << endl; 
for (i=2;i<=SQR-1; i++) 
cin >> u[i] [jl]; 
} 
void printarr(array u,int width,int precision) 
{ 
Tmt. dF 
for (i=1;i<=SQR; i++) 
{ 
for (j=1;3<=SOR; j++) 
cout << setw(width) << setprecision (precision) 
<< ulil [i]; 
cout << endl; 
} 
} 
int main () 
{ 
array u; 
float maxerr,aerr,err,t; 
int i,j,itr,maxitr; 
for (i=1;i<=SQR; i++) 
for (j=1;j<=SOR; j++) 
uli] [j]=0; 
cout << "Enter the boundary conditions" << endl; 


getrow(1,u); getrow(SQR,u) ; 
getcol(1,u); getcol(SQR,u); 
cout << "Enter allowed error," 


<< "maximum iterations" << endl; 
cin >> aerr >> maxitr; 


cout << fixed; 
for (itr=l;itr<=maxitr;itrt+t+) 
{ 
maxerr=0; 
for (i=2;1i<=SQR-1;i++) 
for (j=2; 7<=SQR-1;4++) 
{ 
t=(u[i-1] [j]+tulitt] [31+ 
uli] [j+1]+ulil] [j-1])/4; 
err=fabs (u[i][j]-t); 
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if (err > maxerr) 


maxerr = err; 
uli] [j]=t; 
} 
cout << "Iteration no. " << itr << endl; 


printarr(u, 9,2); 
if (maxerr <= aerr) 


cout << "After " << itr << " iterations" 
<< endl 
<< "The solution:-" << endl; 
printarr(u,8,1); 
return 0; 


} 


cout << "Iterations not sufficient." << endl; 
return 1; 
} 
NOTES: SOR is the size of the square mesh 
u is a 2D Array representing the square mesh 
aerr is the allowed error 
maxitr is the maximum allowed iterations 
itr is a counter which keeps track of number of iterations performed 
maxerr is the maximum error in the mesh in an iteration 
err is error in a particular point of the mesh 
fis the execution time format 
getrow is a subroutine that inputs the ith row of the mesh 
getcol is a subroutine that inputs jth column of the mesh. 


Computer Solution of Exmaple 11.3 (a) 


Enter the boundary conditions 

Enter the value of u[l, j], j = 1, 4 
1000 1000 1000 1000 

Enter the values of u[4, j], 3 = 1, 4 
1000 500 0 0 

Enter the values of u[i, 1], i= 2, 3 
2000 2000 

Enter the values of u[i, 4], i = 2, 3 
500 0 

Enter allowed error, maximum iterations 


ps 


10 
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Iteration No. 1 


1000.00 1000.00 
2000.00 750.00 
2000.00 812.50 
1000.00 500.00 
Iteration No. 2 

1000.00 1000.00 
2000.00 1093.75 
2000.00 984.38 
1000.00 500.00 
Iteration No. 3 

1000.00 1000.00 
2000.00 1179.69 
2000.00 1027.34 
1000.00 500.00 
Iteration No. 4 

1000.00 1000.00 
2000.00 1201.17 
2000.00 1038.09 
1000.00 500.00 
Iteration No. 5 

1000.00 1000.00 
2000.00 1206.54 
2000.00 1040.77 
1000.00 500.00 
Iteration No. 6 

1000.00 1000.00 
2000.00 1207.89 
2000.00 1041.44 
1000.00 500.00 
Iteration No. 7 

1000.00 1000.00 
2000.00 1208.22 
2000.00 1041.61 
1000.00 500.00 
Iteration No. 8 

1000.00 1000.00 
2000.00 1208.31 
2000.00 1041.65 
1000.00 500.00 
After 8 iterations 

The solution:- 

1000.0 1000.0 


2000.0 1208.3 
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2000.0 1041.6 458.3 0.0 
1000.0 500.0 0.0 0.0 


15.28 Solution of Heat Equation (Section 11.9) 


Flow-chart 
Refer to Section 14.28, page 745 
Program 


/*Solution of parabolic equations by 

Bendre Schmidt method*/ 

#include <iostream.h> 

#include <iomanip.h> 

#define XEND 8 

#define TEND 5 float f(int x) 

{ 

return 4*x-(x*x)/2.0; 

} 

int main () 

{ 

float u[XEND+1] [TEND+1],h=1.0,k=0.125, 
csqr,alpha,ust,uet; 


EME. 47 
cout << "Enter the square of 'c'" << endl; 
cin >> csqr; 
alpha = (csqr*k)/(h*h) ; 

cout << "Enter the value of u[0,t]" << endl; 
cin >> ust; 

cout <<"Enter the value of u[" << XEND 

<< ",tj]" << endl; 

cin >> uet; 


cout << fixed; 


for (j=0;j<=TEND; j++) 
u[0] [j]=u[XEND] [j]=ust; 
for (i=1;i<=XEND-1; i++) 
uli] [0]=£(1); 
for (j=0; j<=TEND-1; j++) 
for (i=1;i<=XEND-1; i++) 
ufi] [jt+l]= 
a 


lpha*u[i-1] [3 
+ (1-2*alpha) *u[i] [3] 
31; 


talpha*u[it+l 


cout << "The value of alpha is" 
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<< setw(4) << setprecision (2) 
<< alpha << endl; 

cout << "The values of u[i,j] are:-" 
<< endl; 

for (j=0;j<TEND; j++) 

{ 


for (i=0;1i<=XEND; i++) 
cout << setw(7) << setprecision (4) 
<< ulil[jl; 
cout << endl; 


} 


return 0; 


} 


Notes: XEND is the ending value of x 
TEND is the ending value of t 

h is the spacing in values of x 

k is the spacing in values of y 

fix) is value of u(x, 0) 

csqr is value of C? 

alpha is a 

ust is the value in the first column 

uet is the value in the last column. 


Computer Solution of Example 11.11 


Enter the square of "c" 


4 
Enter value of u(0, t) 
0 
0 


Enter value of u(8, t) 


The value of alpha is 0.50 
The values of u(i, Jj) are:- 


0.0000 3.5000 6.0000 7.5000 8.0000 7.5000 6.0000 3.5000 0.0000 
0.0000 3.0000 5.5000 7.0000 7.5000 7.0000 5.5000 3.0000 0.0000 
0.0000 2.7500 5.0000 6.5000 7.0000 6.5000 5.0000 2.7500 0.0000 
0.0000 2.5000 4.6250 6.0000 6.5000 6.0000 4.6250 2.5000 0.0000 
0.0000 2.3124 4.2500 5.5625 6.0000 5.5625 4.2500 2.3125 0.0000 
0.0000 2.1250 3.9375 5.1250 5.5625 5.1250 3.9375 2.1250 0.0000 
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15.29 Solution of Wave Equation (Section 11.12) 


Flow-chart 
Refer to Section 14.29, page 748 
Program 


/* Solution of Hyperbolic equation */ 
#include <iostream.h> 

#include <iomanip.h> 

#define XEND 5 

#define TEND 5 float f(int x) 

{ 

return x*x* (5-x); 

} 

int main () 

{ 

float u[XEND+1] [TEND+1],csqr,ust,uet; 
EME ay ye 


cout << "Enter the square of 'c'" << endl; 
cin >> csqr; 
cout << "Enter the value of u(0, t)" << endl; 
cin >> us 


cout << "Enter the value of u(" 
END << ", t)" << endl; 
cin >> uet; 


cout << fixed; 
for (j3=0;j<=TEND; j++) 
{ 


u[O][j] = ust; u[XEND] [Jj] = uet; 
} 
for (i=1;i<=XEND-1; i++) 

uli] [1] = ufi] [0] = £(1); 
for (j=1;j<=TEND-1;4++) 

for (i=1;i<=XEND-1;i++) 
uli] [j+1] = ufi-1] [j]+ulit1] [3] 
-ulil[j-1]; 

cout << "The values of u(i, j) are:-" << endl; 
for (j=0;3<=TEND; j++) 


{ 


for (i=0;i<=XEND; i++) 
cout << setw(6) << setprecision(1l) 
<< ulil [jl]; 
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cout << endl, 


} 


return 0; 


} 


NOTES: XEND is the ending value of x 

TEND is the ending value of t f(x) is value of u(x, 0) 
csqr is value of C” 

ust is the value in the first column 

uet is the value in the last column. 


Computer Solution of Example 11.14 


Enter the square of "c" 

16 

Enter value of u(0, t) 

0 

Enter value of u(5, t) 

0 

The values of u(i, Jj) are:- 
0.0 4.0 12.0 18.0 16.0 0.0 
0.0 4.0 12.0 18.0 16.0 0.0 
0.0 8.0 10.0 10.0 2.0 0.0 
0.0 6.0 6.0 -6.0 -6.0 0.0 
0.0 -2.0 =10:...0 =10..:0 -8.0 0.0 
0.0 -16.0 -18.0 -12.0 -4.0 0.0 


15.30 Linear Programming—Simplex Method (Section 12.8) 


Flow-chart 
Refer to Section 14.30, page 750 


Program 


/* Linear programming by simplex method */ 
include <iostream.h> 

include <iomanip.h> 

define ND 2 

define NS 2 

define N (ND+NS) 

define N1 (NS* (N+1) ) 

void init(float x[],int n) 


int i=0; 
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for (;i<n;itt+) x[i] = 0; 
} 
int main () 
{ 
int 1,3,k,kj,ki,bas [NS]; 
float a[NS] [N+1],c[N],cb[NS],th[NS], 
x[ND],cj,z,t,b,min,max; 
/* Initializing the arrays to zero */ 
init(c,N); init(cb,NS); 
init(th,NS); init(x,ND); 
for (i=0;1i<NS;it++) init(a[i],Nt1); 
/* Now set coefficients for slack 
variables equal to one */ 


for (i=0;1i<NS;i++) ali] [it+ND] = 1.0; 
/* Now put the slack variables in the basis */ 
for (i=0;i<NS;i++) bas[i] = NDt+ti; 


/*Now get the constraints 
and the objective function */ 


cout << "Enter the constraints" << endl; 
for (i1=0;i<NS;i++) 
{ 


for (j3=0;3<ND; j++) 

cin >> a[i]l[jl; 

cin >> a[i] [Nl]; 
} 
cout << "Enter the objective function" 

<< endl; 

for (j=0;3<ND;j++) 

cin >> c[j]; 
cout << fixed; 
/*Now calculate cj and identify the incoming variable */ 
while (1) 
{ 


max = 0; kj = 0; 
for (j3=0;43<N; j++) 
{ 
z= 0; 
(1=0; i<NS;1i++) 

z += ch[il*alill[jl; 
cj = clj]-z; 
if(cj > max) 


for 


{max = cj; kj = j;} 
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} 

/* Apply the optimality test */ 
if (max <= 0) break; 

/* Now calculate thetas */ 


; i<NS;it+) 
iJ [kj]!= 0) 


=m H 
ll 

“Oot 
. 


th[i] = a[i][N]/a[il] [kj]; 
if(th[i] > max) max=th[i]; 


/* Now check for unbounded soln. */ 
if (max <= 0) 


cout << "Unbounded solution"; 
return 1; 


} 


/*Now search for the outgoing variable */ 


min = max; ki = 0; 
for (i=0;i<NS;1i++) 
if ((th[i] < min)&&(th[i]!= 0)) 
{ 
min = th[i]; ki = i; 


} 
/*Now a[ki] [kj] is the key element*/ 
t = a[kil] [kj]; 
/*Divide the key row by key element*/ 
for (j=0;j<N+1;j++) a[kil[j] /= t; 
/*Make all other elements of key column zero */ 
for (i=0;i<NS;1i++) 
if(i!= ki) 


{ 


b = afi] [kj]; 
for (k=0;k<N+1; k++) 
a[i] [k] -=a[ki] [k]*b; 
} 
cb[ki] = c[kj]; 
bas[ki] = kj; 
} 
/* Now calculating the optimum value */ 
for (i=0;i<NS;i++) 
if ((bas[i] >= 0) && (bas[i]<ND) ) 
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x[bas[i]] = afi] [N]; 
z= 0; 
(i1=0;i<ND; i++) 
z += c[i]*x[i]; 
for (i=0;i<ND; i++) 
cout << "x[" << setw(3) << itl << "] =" 

<< setw(7) << setprecision (2) 

<< x[i] << endl; 


cout << "Optimal value = " 
<< setw(7) << setprecision (2) 
<< z << endl; 
return 0; 


} 


NOTES: ND is no. of decision variables. 

NS is no. of slack variables. 

a is the array containing Body Matrix, Unit Matrix and b/s 

c is an array containing values of c's 

cb is an array containing values o cs 

th is an array containing values of 6’s 

bas is basis. For x,’s basis contains i, for s,’s basis contains i + ND 
ki is the key row. 

kj is the key column. 


Computer Solution of Example 12.4 


Enter the constraints 

4 2. 80 

2 5 180 

Enter the objective function 
3 «4 

x[ 1] = 2.50 


x[ 2] = 35.00 
Optimal value = 147.50 


Computer Solution of Example 12.16 


Enter the constraints 

2 3 2 440 

4 0 3 470 

2 5 0 430 

Enter the objective function 
4 3 6 

x[ 1] = 0.00 
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x[ 2] = 42.22 
x[ 3] = 156.67 
Optimal value = 1066.67 


Exercises 15.1 


10. 


11 


. Write a C++ program which prints all odd positive integers less than 100, 


omitting those integers divisible by 7. 


. Write a C++ program to convert a binary number to its equivalent deci- 


mal number. 


. Write a C++ program to calculate N! and use this to evaluate 
N! 
No. ==——~ 
“x K\(N—K)! 


. Determine the number of integers n, 1 <n < 2000, that are not divisible 


by 2, 3 or 5 but are divisible by 7. 


. Write a C++ program to evaluate the roots of the equation ax* + bx +c 


=0. 


. Write a computer program in “C++” for finding a real root of the equa- 


tion f(x) = 0 by the bisection method. 


. Write a C++ program to find a real root of x° — 4x — 9 = 0 using the 


method of false position. 


. Write an algorithm for the Newton-Raphson method to solve the equa- 


tion f(x) = 0. Apply the same to solve cos x — xe* = 0 near x = 0.5 correct 
to three decimal places. 


. Write a C++ program to solve the following equations by the Gauss- 


Seidal method: 
83x + lly —4z = 95; 7x + 52y + 13z = 104; 3x + Sy + 29z = 71. 


With the help of a flow chart, write a C++ program to solve: 


75x + 3.8y + 2.92 = 15; 3.2e + 6.8y + 7.4z = 37; 13x + Qly + 3.22 = 7, 
using the factorization method. 


. Write a complete C++ program to (i) Add two matrices (ii) Multiply two 


matrices. 


12. 


13. 


14. 


15. 
16. 
17. 


18. 


19. 


20. 
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Given the data: 
x: 5 10 15 20 95 30 
y: 17 25 30 33 36 38 
Write a C++ program to fit a quadratic relation using least square crite- 
rion. 


Write a program in C++ to estimate f(0.6) by the Lagrange interpolation 
for the following values: 

x : 0.4 0.5 0.7 0.8 
fix): — 0.916 | — 0.693 | — 0.357 | — 0.223 


10. 
Write a C++ program to evaluate i : x(x? + 2)dx using Simpson’s rule. 


4 
Write “C++” program for evaluation of i ; f(x) Simpson’s 3/8th rule. 
Write a program in “C++” for second order Runge-Kutta method. 


Develop a “C++” program for solving differential equations using the 
Runge-Kutta fourth order formulae. 
Write a C++ program to find y(0.8) for the differential equation 


dy/dx = s(n +y), given the following table using Milne’s Predictor- 


Corrector method: 
x: 0 0.2 0.4 0.6 
y: 2 2.636 3.595 4.968 


Write a computer program in C++ to maximize 

z= 6x, + 4x, 
subject to 2x1+ 3x, < 100, 4x, + 2x, < 120, x,, x, 2 0, where x,, x, are the 
number of items to be produced. 


Develop a computer program in C++ for Example 12.17 and hence 
solve it. 


CHAPTER 


NUMERICAL METHODS 
Using MATLAB 


Chapter Objectives 

e Introduction 

e An overview of MATLAB features 

e 3 to 30 Programs of standard methods in MATLAB 


16.1. Introduction 


MATLAB is a numerical computing, fourth generation pro- 
gramming language built around an interactive programming envi- 
ronment. There is no need to compile, link, and execute after each 
correction, thus MATLAB programs can be developed in much 
shorter time than equivalent C or C++ programs. It has many built- 
in functions that make the learning of numerical methods much 
easier and interesting. Developed by Math Works, MATLAB al- 
lows matrix manipulation, plotting of functions and data, imple- 
mentation of algorithms, creation of user interfaces, and interfacing 
with programs of other languages. Although it is numeric only, an 
optional toolbox uses the MuPAD symbolic engine, allowing access 
to other algebraic capabilities. An additional Package, Simulink, 
adds graphical multidomain simulation and model based design 
for dynamic and embedded systems. MATLAB (meaning “matrix 
laboratory’) was created in the late 1970s, by Cleve Moler, then 
chairman of the computer science department at the University of 
New Mexico. 
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16.2 An Overview of MATLAB Features 


<>» 


Variables. Variables are defined with the assignment operator, “=”. 
MATLAB is a weakly dynamically typed programming language. It is a 
weakly typed language because types are implicitly converted. It is a dy- 
namically typed language because variables can be assigned without declar- 
ing their type, except if they are to be treated as symbolic objects and that 
their type can change. Values can come from constants, from computation 
involving values of other variables, or from the output of a function. For 


example: 

>>x=17 x= 

17 

>>x="hat' 

sce 

hat 

>>x=[3*4, pi/2] 
— 


12.0000 1.5708 

>>y=3*sin (x) 

y= 

-1.6097 3.0000 

Variable names, which must start with a letter, are case sensitive. Hence sun 
and Sun represent two different variables. Variables that are defined within 
a MATLAB function are local in their scope. They are not available to other 
parts of the program and do not remain in memory after exiting the func- 
tion (this applies to most programming languages). However, varables can 
be shared between a function and the calling program if they are declared 


global. 


Vectors/Matrices. MATLAB is a “Matrix Laboratory” and as such it offers 
many ways to create vectors, matrices, and multidimensional arrays ina 
convenient way. In the MATLAB vernacular, a vector refers to a one-di- 
mensional (1 x N or N x 1) matrix, commonly referred to as an array in oth- 
er programming languages. A matrix generally refers to a two dimensional 
i.e. m x n array where m and n are greater than or equal to one. Arrays with 
more than two dimensions are referred to as multidimensional arrays. 


MATLAB provides a simple way to define simple arrays using the syn- 
tax: init: increment: terminator. For example: 
>>a=[1:2:10] 
a= 
1357 9 
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defines a variable named “a” (or assigns a new value to an existing variable 
“a”) which is an array consisting of elements 1, 3, 5, 7, and 9. That is, the ar- 
ray starts at | (init value), increments uniformly by 2 (increment value) until 
it reaches its final value (terminator value). The increment value can actu- 
ally be left out of this syntax (along with one of the colons), to use a default 
value of one. For example: 
>>a=[1:5] 
a= 

a, 3 a. 15 


Indexing is one based, which is usually the convention in mathematics, but 
not in some programming languages. 

Matrices can be defined by separating elements of a row by blank 
space or comma and terminating a row by a semicolon. The list of elements 
should be surrounded by square brackets: [ ]. Parenthesis: ( ) are used to 


access elements and subarrays. They are also used to denote a function 
argument list. 


>>A=[1 2 3 4; 23 4 5; 567 8; 35 2 6] 


hm a B® Ww 
non ss 


Sets of indices can be specified by expressions such as “2:4”, which evalu- 
ates to (2, 3, 4). For example, a submatrix taken from rows 2 to 4 and col- 
umns 3 to 4 can be written as: 


>>A(2:4, 3:4) 
ans= 

45 

78 


26 
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A square identity matrix of size n can be generated using the function eye 
and matrices of any size containing all zeros or ones can be generated by 
using functions zeros and ones respectively. For example: 


>>A=eye (3) A= 


10 O 
01 0 
00 1 


>>B=zeros(2, 3) B= 
00 O 


>>C=ones(3, 4) 


C= 
Tae i 
5 Ei 
Ta il 


To know, the size of an already defined array, commands length and size are 
used. Most MATLAB functions can accept matrices and will apply them- 
selves to each element. For example, mod (2*J, n) will multiply each ele- 
ment in J by 2 and then reduce each element modulo “n.” MATLAB does 
include standard “for” and “while” loops, but using MATLAB’s vectorized 
notation often produces code that is easier to read and faster to execute. 
This code excerpted from the function magic.m, creates a magic square M 
for odd values of n (MATLAB function meshgrid is used here to generate 
square matrices I and J containing 1: n). 


[J,I]=meshgrid (1:n); 
A=mod (I+J-(n+3)/2,n); 
B=mod (I+2*J-2,n); M=n*A+Bt1; 
The apostrophe (prime) operator (’) takes the complex conjugate trans- 
pose and has the same function as a transpose operator for real-valued ma- 
trices. For example: 
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>>A=[1 2 3; 3 4 5] A= 


1 2 3 
3 4 5 
>>B=A’' 
B= 
1 3 
2 4 
3 5 


The compatibility of dimensions must be observed while working with 
matrices, for example, while multiplication and extension of an existing ma- 
trix or defining another one based on it. For instance, if it is tried to annex 
a 4 x | matrix into the 3 x 1 matrix, MATLAB will reject it squarely, giving 
an error message. 


Also, a dot (.) must be put in front of the operator for termwise (ele- 
ment-by-element) operations. For example: 


>>A=[2 5 3; 3 4 6]; 
>>B=[3 4 8; 3 5 6]; 


>>C=A.*B 


Semicolon. Unlike many other languages, where the semicolon is used to 
terminate commands, in MATLAB the semicolon serves the purpose of 
suppressing the output of the line that it concludes. 


Arithmetic Operators. All usual arithmetic operators such as (+) Addi- 
tion, (—) Subtraction, (*) Multiplication and (*) Exponentiation are sup- 
ported by MATLAB. Their matrix operation is as illustrated below. 


>>A=[2 4 6; 1 2 5] 
A= 
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>>B=[1 7 8; 3 2 7] B= 


dL 7 8 
3 2 7 
>>C=A+B 
C= 
3 Tot 14 
4 4 12 
>>D=A*B' 
D= 
78 56 
55 42 


There are two division operators in MATLAB: / Right division and\Left 
division. The right division x/y results in x divided by y, where x and y are 
scalars whereas the left division is equivalent to y/x. In the case where A 
and B are matrices, A/B returns the solution of X * A = B and A\B yields the 
solution of A * X = B. 


Logical Operators. The various logical operators in MATLAB are (&) 
AND, (|) OR and (~) NOT. The related examples are shown below. 


>>A=[2 3 8;3 2 5]; 


>>B=[2 4 6; 2 4 7]; 
>> (A>B) | (B>6) 


ans= 


1 0 1 
Relational Operators. The relational operators supported by MATLAB 
are < Less than, > Greater than, < = Less than or equal to, > = Greater 
than or equal to, = Equal to, ~ = Not equal to. These operators always 
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act element-wise on matrices; hence they result in a matrix of logical type. 
These operators return | for true and 0 for false. For example, 


>>A=[2 6 4; 3 7 5]; 

>>B=[8 4 3; 2 9 7T|; 

>>A>B 

ans= 

Graphics. Function plot can be used to produce a graph from two vectors 


x and y. The code is as shown below produces the following figure of sine 
function. 


>>x=0:pi/100:2*pi; 
>>y=sin(x); 


>>plot (x,y) 


Three dimensional graphics can be produced using the functions surf, 
plot 3, or mesh. 


0 1 2 3 4 5 6 va 


Structures. MATLAB supports structure data types. Since all variables 
in MATLAB are arrays, a more adequate name is “structure array,” where 
each element of the array has the same field names. In addition, MAT- 
LAB supports dynamic field names (field look-ups by name, “field manip- 
ulations, etc.) Unfortunately, MATLAB JIT does not support MATLAB 
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structure, therefore just a simple bundling of various variables in to a struc- 
ture will come at a cost. 


Function handles. MATLAB supports elements of lambda-calculus by 
introducing function handles, a references to functions, which are imple- 
mented either in files or anonymous/nested functions. 


Classes. MATLAB supports classes, however the syntax and calling con- 
ventions are _ significantly different than in other languages, because MAT- 
LAB does not have reference data types. For example, a call to a method 


object.method (); 


cannot normally alter any variables of object variable. To create an impres- 
sion that the method alters the state of variable, MATLAB toolboxes use 
the evalin ( ) command, which has its own restrictions. 


Object-Oriented Programming. MATLAB’s support for object-oriented 
programming includes classes, inheritance, virtual dispatch, packages, pass- 
by-value semantics, and pass-by-reference semantics. 


classdef byee 
methods 
function outputl (this) 
disp ('byee') 
end 
end 
end 


When put in a file named m, this can be executed with the following com- 
mands: 


>>x=byee; 
>>x.outputl; 
Byee 


Programs of Standard Methods In Matlab 


16.3 Bisection Method (Section 2.7) 


Flow-chart 
Refer to Section 14.3, page 674 
Program 


function[]=Bisection Method () 
ele 
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itr=0; 

a=input ("Enter the value of a:'); 
b=input('Enter the value of b:'); 

aerr= input('Enter the allowed error:'); 
maxitr=input {'Enter the maximum Iterations:'); 


[x itr]=bisect(a,b,itr); 
while (itr<maxitr) 
if (f(a) *£ (x) <0) 
b=x; 


else 
a=x; 
end 
[xl itr]=bisect(a,b,itr); 
if (abs (x1-x) <aerr) 
fprintf{'After %d iteration ,root = %f \n',itr,xl) 
return 
end 
x=x1; 
end 
fprintf('Iterations not sufficient,solution does not 
converge \n); 
function[x itr _r]=bisect(a,b,itr) 
if nargin <2, b=2; end 


x=(atb) /2; 

Lor FaLtrtl 5 

fprintf('Iteration no. $d X = Sf \n',itr,x) 
end 

function[y] =f (x) 

y= (X*K*K-4*X-9) 7 

end 

end 


NOTES: a, b are the limits in which the root lies 
aerr is the allowed error 


maxitr is the maximum number of iterations to be performed 
x is the value of root at nth iteration. 

xl is the value of the root at (n + 1)th iteration 

Function Bisect: 

Purpose: Performs and prints the result of one iteration 
Variables: x is the result of the current iteration. 


itr is the counter which keeps track of the number of iterations performed 
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Computer Solution of Example 2.15 (a) 


iy 
Dy 
co 
Dy 


iy 
Dy 


I 
I 


I 
i 
I 
I 
I 
dt 
I 
I 
I 
ie 
I 
I 


maximum Iterations: 20 


After 14 iteration, 


rror:0.0001 


500000 


- 750000 
- 625000 
- 687500 
. 718750 
703125 
- 710938 
- 707031 
- 705078 
- 706055 


- 706543 
- 706299 
- 706421 
- 706482 


Enter the value of a:3 
Enter the value of b:2 
Enter the allowed 
Enter the 
teration no. 0 X=2. 
teration no. 1 X=2 
teration no. 2 X=2 
teration no. 3 X=2 
teration no. 4 X=2 
teration no. 5 X=2 
teration no. 6 X=2 
teration no. 7 X=2 
teration no. 8 X=2 
teration no. 9 X=2 
teration no. 10 X=2 
teration no. 11 X=2 
teration no. 12 X=2 
teration no. 13 X=2 


root=2.706482 


16.4 Regula-Falsi Method (Section 2.8) 


Flow-chart 
Refer to Section 14.4, page 676 


Program 


function[]=Regula_Falsi () 


Cc 
Cc 
x 
x 
a 
m 


LC 


O=input ('En 


l=input ('En 
err=input (' 
axitr=input 
x2 itr]=regula(x0,x1l,f(x0),f(x1),itr); 


lear all itr=0; 


ter the value of x0:'); 
ter the value of xl:"'); 
Enter the allowed error:'); 
("enter the maximum no. of iterations:'); 


while (itr<maxitr) 


e 


if (f (x0) *£ (x2) <0) 
xl=x2; 

lse 
x0=x2; 


end 
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[x3 itr]=regula(x0,xl,f(x0),f£(x1),itr); 
if (abs (x3-x2)<aerr) 
fprintf('After %d iteration, roots %f\n',itr,x3) 
return 
end 
x2=x3; 
end 
fprintf('Iterations not sufficient, solution does not 
converge \n'); 
function [x itr r]=regula(x0,x1,fx0,fx1,itr) 
x=x0-((x1-x0)/(£x1-f£x0)) *£x0; 
LEY PSLi rl; 
fprintf ('iteration no. %d X=%f/n',itr,x) 
end 
function [y]=f (x) 
y=(cos (x)-x*exp(x)); 
end 
NOTES: f(x) = 0 is the equation whose root is to be found 
x0, x, are units in which root lies 
aerr is allowed error 
maxitr is maximum number of iterations to be performed 
itr is the counter which keeps track of the number of iterations performed 
x, is value of root at nth iteration 
x, is the value of root at (n + 1) th iteration 
Function Regula: 
Purpose: Performs and prints the result of one iteration 
Variables: x is value of root at nth iteration 
fx, fx, are value of f(x) at x, and x,, respectively. 


Computer Solution of Example 2.20 


Enter the value of x0:0 

Enter the value of xl:1 

Enter the allowed error:0.0001 

enter the maximum no. of iterations:20 
iteration no. 0 X=0.314665 


iteration no. 1 X=0.446728 
iteration no. 2 X=0.494015 
iteration no. 3 X=0.509946 
iteration no. 4 X=0.515201 
iteration no. 5 X=0.516922 
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iteration no. 6 X=0.517485 
iteration no. 7 X=0.517668 
iteration no. 8 X=0.517728 
After 9 iteration, roots 0.517728 


16.5 Newton Raphson Method (Section 2.11) 


Flow-chart 
Refer to Section 14.5, page 679 
Program 


function[]=Newton_Raphson () 

cle 

clear all 

f=inline('x*logl0(x)-1.2"'); 
df=inline ('logl0(x)+.43429'); 

x0=input('Enter the value of x0:'); 


aerr=input('Enter the allowed error:'); 
maxitr=input ('enter the maximum no. of iterations:'); 
for itr=l:l:maxitr 
h=f (x0) /df (x0); 
xl=x0-h; 
fprintf('iteration no. %d X=%f \n',itr,xl) 
if (abs (h) <aerr) 
fprintf('After %d iteration, roots %f\n',itr,xl1l) 
return 
end 
x0=x1; 
end 
fprintf('Iterations not sufficient,solution does not 
converge \n"') 


end 


NOTES: F(x) = 0 is the equation whose root is to be found 

df(x) is the derivative of f(x) w.r.t. x aerr is allowed error 

maxitr is maximum number of iterations to be performed 

itr is the counter which keeps track of the number of iterations performed 
x0 is value of root at nth iteration 

xl is the value of root at (n + 1)th iteration 


Computer Solution of Example 2.32 


Enter the value of x0:2 
Enter the allowed error:0.000001 
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enter the maximum no. of iterations:10 
iteration no. 1 X=2.813170 

iteration no. 2 X=2.741109 

iteration no. 3 X=2.740646 

iteration no. 4 X=2.740646 

After 4 iteration, roots 2.740646 


16.6 Muller’s Method (Section 2.13) 


Flow-chart 
Refer to Section 14.6, page 681 
Program 


function[]=Mullers method () 
ele 

clear all 

I = 3; 


y=inline{'cos(x)-x*exp(x) ' ); 


disp('Enter the initial approximations"); 
for 1=1-2:1:3 


x(i)=input(''); 
end 
aerr= input{'Enter the allowed error:'); 
maxitr=input ('enter the maximum no. of iterations:'); 


for itr=l:l:maxitr 
li=(x(I)-x(1-1) )/(x (1-1)-x{I-2)); 
di=(x(I)-x(I-2))/{x(1-1)-x{I-2)); 
mu=y (x (I-2)) *li*li-y(x(1-1)) *di*dity(x(1I))*(litdi); 
s=sqrt ((mu*mu-4*y{x (1) ) *di*li* (y(x(1-2))* 


li-y(x(1-1)) *dity(x(I))))); 
if (mu<0) 
1=(2*y(x(I)>*di) /(-muts) ; 
else 
1= (2*y (x (1) }*di) / (-mu-s) ; 
end 


(T+ 1) =x (1 )+l* (x (1)—e(T=1))3 
fprintf{'iteration no. %d X = Sf \n',itr,x(1+1)) 
if (abs (x (1+1)-x(I))<aerr) 


fprintf ('After td iterations, the solution is %f\n',itr,x(1+1)) 


return 
end 
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for i=1-2:1:3 
x(i)=x (itl); 
end 
end 
fprintf{'Iterations not sufficient,solution does not 
converge \n'); 


NOTES: y(x) = 0 is the equation whose root is to be found 

x is na array which holds the three approximations to the root and the new 
improved value 

I is defined as 3 in the program. This has been done because in 
MATLAB, array subscripts always start from 1 and cannot be negative. 
Use of 1 facilitates more readable expressions. For e.g., x[0] can be 
written as x[I-3] which looks more like X, ,, which it actually represents. 
liis A, 

di is 6, 

mu is Ll, 

sis Vie? 7 4yi }, A, (Y.5 A, on }, es yi] 

lisA 


Computer Solution of Example 2.34 


Enter the initial approximations 

= 

0 

1 

Enter the allowed error:0.0001 

enter the maximum no. of iterations:10 
iteration no. 1 X=0.441517 

iteration no. 2 X=0.512546 

iteration no. 3 X=0.517693 

iteration no. 4 X=0.517757 

After 4 iterations, the solution is 0.517757 


16.7 Multiplication of Matrices [Section 3.2 (3)4] 


Flow-chart 
Refer to Section 14.7, page 684 
Program 


ole 


Ml=input ('Enter the element of first matrix'); 
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M2=input{'Enter the element of second matrix'); 
mul=M1*M2-M2; 
disp('Result after multiplication is:') 


disp (mul) 
Computer Solution of Example 3.7 


Enter the element of first matrix [0 1 2; 1 2 3; 2 3 4] 
Enter the element of second matrix [1 -2; -1 0; 2 -1] 
Result after multiplication is: 


3. =2 
mS “= 
7 -8 


16.8 Gauss Elimination Method [Section 3.4 (3)] 


Flow-chart 
Refer to Section 14.8, page 687 
Program 


function[]=gauss_ elimination _method() 
cle 
N=4; 
a=input ('Enter the element of matrix:-') 
for j=1:N-1 
for i=j+1:N 
t=a(i,j)/a (3,3); 
for k=1:N+1 
a(i,k)=a(i,k)-a(j,k) *t; 


end 
end 
end 
for i=1:N 


for j=1:N+1l 
fprintf('S8.4f',a(i,j)); 
end 
fprintf('\n'); 
end 
for i=N:-l:1 
s=0; 
for j=itl:N 


s=sta(i,jtl).*x(4); 
end 
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end 


Notes: N is the number of unknowns 

a is an array which holds the augmented matrix 

x is an array which will contain values of unknowns 
i,j, k are loop control variables. 


Computer Solution of Example 3.19 


Enter the element of matrix:-[10 -7 3 5 6; -6 8 -1 -4 5; 314 
17 -23-5,-=9: 2 4 7] 

10.0000 -7.0000 3.0000 5.0000 6.0000 

0.0000 3.8000 0.8000 -1.0000 8.6000 

0.0000 0.0000 2.4474 10.3158 -6.8158 

0.0000 0.0000 0.0000 9.9247 9.9247 

x= 

-3.3947 -0.6842 7.0000 1.0000 


16.9 Gauss-Jordan Method [Section 3.4 (4)] 


Flow-chart 
Refer to Section 14.9, page 689 


Program 
function[]=gauss_ jordan _method() 
N=4; 
a=input (‘Enter the element of matrix:-\n'); 
for j=1:N 
for i=1:N 
Lf (ix=]) 
t=a(i,j)/a(j,3j)F 
for k=1:N+1 
a(i,k)=a(i,k>-a(j,k).*t; 
end 
end 
end 
end 


fprintf('\nThe diagonal matrix is:-\n"') 
disp (a) 
fprintf('\nThe solution is:-\n') 
for i=1:N 
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fprintf('x[Sd]=Sf\n',i,a(i,N + 1)./a(i,i)); 
end 


Notes: a is an array which holds the Augmented Matrix 

N is the number of unknowns e.g. if it is a 3 x 3 system of equations, 
N = 3andif5 x 5 system take N =5 

i, j, k are loop variables. 


Computer Solution of Example 3.22 


Enter the element of matrix:- 
[10 -7 3 5 6; -6 8 -1 -4 5; 31411 2; 5 -9 -2 4 7] 
The diagonal matrix is: 


10.0000 0 0) 0 50.00.00 
0 3.8000 0 0) 15.2000 
0) 0) 2.4474 0 = 1.136 
0 0 0) 9.9247 9.9247 


The solution is:- 
x[1]=5.000000 


] 
x[2]=4.000000 
x[3]=-7.000000 
x[4]=1.000000 


16.10 Factorization Method [Section 3.4 (5)] 


Flow-chart 
Refer to Section 14.10, page 691 
Program 


function []=Factorization_method() 
GLE 

clear all 

N=3; 

u=zeros (N,N); 

v=zeros(N,1); 

x=ones (N,1); 


a=input('Enter the element of matrix'); 
b=a(:,N); 
l=zeros(N); 
for m=1:N 
urow (m) 
lcol (m) 
end 
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disp (u); 

disp(1); 

for i=1:N 
s=0; 


for j=l:i-l 
s=s+[1(i,j)*v(j)]F 


end 
for i=N:-1l:1 
s=0; 
for j=i+l:N 
s=st[u(i,j)*x(j) J]; 


end 
x(i)=(v(i)-s)/u(i,i); 
end 
disp (x) 
function[]=urow (i) 
for j=i:N 
s=0; 
for k=1:N 
s=st[u(k,j).*1(1,k) J]; 
u(i, j)=a (i, Jj) -s; 
end 
end 
end 


function[]=lcol (j) 
for i=j:N 
s=0; 
for k=1:4 
s=s+[u(k,j).*1(i,k)]; 
if i==j 
14a, jes 
else 
1(i,3)=(a(i,j3)-s)/u(j,3)3 
end 
end 
end 
end 
end 
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i=l 
NOTES: uy =a; >) (tli) 


=] 


jl | 
y= E 7 Dae (la) by 


N is the number of unknowns 

l is the lower triangular matrix 

u is the upper triangular matrix 

a is the coefficient matrix 

b is the constant matrix (column matrix) 
v is a matrix such that lv = b 

x will contain the values of unknowns 
i,j, m are loop control variables 


Computer Solution of Example 3.23 


Enter the element of matrix [3 2 7 4; 2315; 341 7] 
3.0000 2.0000 7.0000 
0 1.6667 -3.6667 
0 0 -1.6000 
1.0000 0 0 
0.6667 1.0000 0 
1.0000 1.2000 1.0000 
0.8750 
1.1250 
-0.1250 


Computer Solution of Example 3.24 


Enter the element of matrix [10 -7 3 5 6; -6 8 -1 -4 5; 
1127 5 =9 =2 4 7] 


10.0000 -7.0000 3.0000 5.0000 
0 3.8000 0.8000 -1.0000 
0) 0) 2.4474 10.3158 
0 0) 0 9.9247 
1.0000 0 0) 0 
-0.6000 1.0000 0 0) 
0.3000 0.8158 1.0000 0 
0.5000 -1.4474 -0.9570 1.0000 
5.000 
4.000 
-7.000 


1.000 


3 


1 


4 
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16.11 Gauss Siedel Iteration Method [Section 3.5 (2)] 


Flow-chart 
Refer to Section 14.11, page 695 
Program 


function[]=Gauss Seidal Method() 
clear all cle 


a=input (‘Enter the element of matrix:\n'); 


aerr=input ('Enter the allowed error:'); 
maxitr=input ('enter the maximum no. of iterations:'); 
N=4; 


x=zeros(1,N); 
fprintf ("iterations x[l] x[2] x[3] x[4]\n' 
for itr=l:maxitr 
maxerr=0; 
for i=1:N 
s=0; 
for j=1:N 
if (j~=1) 
s=sta(i,j)*x(j); 
end 
end 
t=(a(i,N+1l)-s) /a(i,i); 
err=abs(x(i)-t); 
if (err>maxerr) 


Maxerr=err; 


end 
x(i)=t; 
end 
fprintf ('%d',itr) 
for i=1:N 


fprintf('Sf"',x(i)) 
end 
fprintf ('\n') 
if (maxerr<aerr) 
fprintf('Converges in %d, iteration \n',itr) 
for i=1:.N 


fprintf ('x(%d)=%2.4f \n',i,x(i)) 


end 
return 
end 
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end 
fprintf('Solution does not converge, iteration not sufficient 
\n') 
return 
end 


NOTES: N is the number of unknowns 

a is an array which holds the augmented matrix 

x is an array which hold the values of unknowns 

aerr is allowed error 

maxitr is the maximum no. of iterations to be performed 

itr is the counter which keeps track of number of iterations performed 
err is the error in value of xi 

maxerr is maximum error in any value of xi after an iteration 


Computer Solution of Example 3.28 


Enter the element of matrix: 
[20 1 -2 17; 3 20 -1 -18; 2 -3 20 25] 
Enter the allowed error:0.0001 


enter the maximum no. of iterations:10 


iterations x[1] x[2] x[3] x[4] 
Hn 0.850000 -1.027500 1.010875 
2 1.002463 -0.999826 0.999780 
3 0.999969 -1.000006 1.000002 
4 1.000001 -1.000000 1.000000 
Converges in 4, iteration 
x (1) =1.0000 
x(2)=-1.0000 
x (3) =1.0000 


Computer Solution of Example 3.30 


Enter the element of matrix: 
[10 =2: 1, =1 Ses2. 0. <1 <1 T5¢=1 =1 10 =2 277= 1 =1 =2 10 =9] 
Enter the allowed error:0.0001 


enter the maximum no. of iterations:15 


iterations x[1] x[2] x13] x[4] 
iL 0.300000 1.560000 2.886000 -0.136800 
2 0.886920 1.952304 2.956562 -0.024765 
3 0.983641 1.989908 2.992402 -0.004165 
4 0.996805 1.998185 2.998666 -0.000768 
5 0.999427 1.999675 26999757 -0.000138 
6 0.999897 1.999941 2.999956 -0.000025 
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7 0.999981 1.999989 2.999992 -0.000005 
Converges in 7, iteration 
x (1)=1.0000 
x (2) =2.0000 
x (3) =3.0000 
x (4) =-0.0000 


16.12 Power Method (Section 4.11) 


Flow-chart 
Refer to Section 14.12, page 699 
Program 


function[]=Power Method () 
clear all 
cle 


= 


a=input (‘Enter the element of matrix:\n'); 
x=input ('Enter the initial approximation to the eigenvector:\n') 
[N M]=size(a); 


aerr= input ('Enter the allowed error:'); 


maxitr=input('enter the maximum no. of iterations:'); 


dispt'itr No. Eigen Value Eigen vector') 
e=max (x); 


for itr=l:maxitr 
r=a*x; 
t=max (abs (r)); 
t=t(1); 
r=r/t; 
maxe=0; 
for i=1:N 
err=abs (x(i)-r(i)); 
if (err>maxe) 
maxe=err; 
end 
x(i)=r(i); 
end 
errv=abs (t-e); 
e=t; 
fprintf£ ('%d%f',itr,e) 
for i=1:N 
fprintf('sf',x(1)) 
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end 

fprintf('\n*) 
if ((errv<=aerr) && (maxe<=aerr) ) 
fprintf{'Converges in %d iterations \n',itr); 


fprintf('Largest eigenvalue=%1.2f \n',e); 


fprintf('Eigen Vector:-\n'); 
fprint£('%$1.2£ \n',x); 
return end 
end 

end 


NOTES: N is the number of rows (or columns) in square matrix 
a is the square matrix 

x is the eigenvector at nth iteration 

r is the eigenvector at (n + 1 )th iteration 

e is the eigenvalue at nth iteration 

t is the eigenvalue at (n + 1)th iteration 

aerr is allowed error in eigenvalue and eigenvector 

maxitr is the maximum number of iterations to be performed 
errv is the error in eigenvalue 

itr, i are loop control variables 


Computer Solution of Example 4.11 


Enter the element of matrix: 

[2-1 07-1 2=17:0=1, 2] 

Enter the initial approximation to the eigenvector: 
[10 0] 

Enter the allowed error:0.01 

enter the maximum no. of iterations:10 


itr No. Eigenvalue Eigenvector 
1 2.000000 1.000000 -0.500000 0.000000 
2 2.500000 1.000000 -0.800000 0.200000 
3 2.800000 1.000000 -1.000000 0.428571 
4 3.428571 0.875000 -1.000000 0.541667 
5 3.416667 0.804878 -1.000000 0.609756 
6 3.414634 0.764286 -1.000000 0.650000 
7 3.414286 0.740586 -1.000000 0.673640 
8 3.414226 0.726716 -1.000000 0.687500 
9 3.414216 0.718593 -1.000000 0.695621 


Converges in 9 iterations 


Largest eigenvalue=3.41 


EBigenvector:- 
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0.72 
-1.00 
0.70 


16.13 Method of Least Squares (Section 5.5) 


Flow-chart 
Refer to Section 14.13, page 703 
Program 


function[]=Least_square Method() 
clear all 

cle 

augm=zeros (3,4); 


n=input ('Enter the number of pair of observation value:-\n'); 
augm(1,1)=n; 
for i=l:n 
fprintf('Pair no. %d \n',i) 
x=input(' '); 
xsq=x(1)*x(1); 
augm(1,2)=augm(1,2)+x(1); 
augm(1,3)=augm(1,3)+xsq; 
augm(2,3)=augm(2,3)+x(1)*xsq; 
augm (3,3)=augm(3,3)+xsq*xsq; 
augm(1,4)=augm(1,4)+x(2); 
augm(2,4)=augm(2,4)+x(1)*x(2); 
augm(3,4)=augm{3, 4) +xsq*x (2); 
end 
augm(2,2)=augm(1,3); 
augm(3,2)=augm(2,3); 
2,1)=augm(1,2); 
3,1)=augm(2,2); 


( 
augm ( 
augm ( 
disp('The augmentd matrix is:-') 
disp (augm) 
for j=1:3 
for i=1:3 
if (i~=j) 
t=augm(i,j)/augm(j,j); 
for k=1:4 
augm(i,k)=augm(i,k)-augm(j,k) *t; 
end 


end 
end 
end 
a=augm(1, 4) /augm ( 
b=augm (2,4) ( 
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fprintf('a=sf b=%f c=%f \n',a,b,c) 


n is the number of data points 


Notes: augm is the augmented matrix 


Computer Solution of Example 5.7 


- 
Pair no.l 
1 ae] 
Pair no.2 
1.5 
Pair no.3 
21.6] 
Pair no.4 
Qe 2) 
Pair no.5 
3 2.7) 
Pair no.6 
345 
Pair no.7 

4 4.1] 

[The augmentd matrix is:- 
7.0000 17.5000 
17.5000 50.7500 
50.7500 161.8750 


a 


50.7500 
161.8750 
548.1875 


Enter the number of pair of observation value:- 


16.2000 
47.6500 
154.4750 


a=1.035714 b=-0.192857 c=0.242857 


16.14 Method of Group Averages (Section 5.9) 


Flow-chart 


Refer to Section 14.14 , page 706 


Program 


function []=Method_Of Averages () 


cle 
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format compact 
format short g 


n=input ('Enter the No of Observations:-'); 
t=input('Enter the different values of t:-') 

disp(The Values of t are:') 

disp(t); 

r=input ('Enter the Corresponding values of r') 


disp('The Values of r are:') 
disp(r); 
tsl=0;rsl=0;ts2=0;rs2=0; 
for i=1:(n/2) 
tsl=tsl+t (i); 
rsl = rslt+r(i); 


end 
for i=(n/2)+l:in 
ts2=ts2+t (i); 
rs2=rs2tr (i); 


end 

xl=tsl/(n/2); 
yl=rsl/(n/2); 
x2=ts2/(n/2); 
y2=rs2/(n/2); 
b=(y2-yl) /(x2-x1) ; 
a=yl-(b*xl); 
disp('The values of a&b comes out to be:') 
a 
b 
end 


Computer Solution of Example 5.16 


Enter the No of Observations:-8 
Enter the different values of t:-[40 50 60 70 80 90 100 110] 


40 50 60 70 80 90 100 110 

The Values of t are: 

40 50 60 70 80 90 100 110 

Enterthe Corresponding values of r[1069.1 1063.6 1058.2 1052.7 
1049.3 1041.8 1036.3 1030.8] 


r= 


Columns 1 through 7 
1069.1 1063.6 1058.2 1052.7 1049.3 1041.8 1036.3 
Column 8 
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1030.8 
The Values of r are: 

Columns 1 through 7 

1069.1 1063.6 1058.2 1052.7 1049.3 1041.8 1036.3 
Column 8 


1030.8 


- 


[The values of a&b comes out to be: 
a=1090.3 
b=-0.53375 


16.15 Method of Moments (Section 5.11) 


Flow-chart 
Refer to Section 14.15, page 708 
Program 


function [ ]=Method_Of Moments () 
cle 
format compact 


n=input('Enter the No of Observations:-'); 
x=input('Enter the different values of x:-'); 
y=input ('Enter the Corresponding values of y') 


h=x (2) -x(1); 
xlyt=0; yt=0; 
for i=lin 
yt=ytty (i); 
xlyt=xlyt+x(i).*y(i); 
end 
ml=h.*yt; 
m2=h.*xlyt; 
11=(-(h/2)+x(1)); 
12=((h/2)+x(n)); 
cl=12-11; 
e2=((12.*12)=-{11.*11)) /2; 
c3=((12.*12.*12)-(11.*11.*11)) /3; 
fprintf('The Observed Equations are:\n"') 
fprintf ('$5.2fa+%5.2fb=%5.2f\n *%5.2fat%5.2fb=35.2f\ 
n',cl,c2,ml1,c2,c3,m2) 


d=c2/cl1; 
dl=d*cl; 
d2=d*c2; 
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ml=d*ml1; 

b=(m2-m1) / (c3-d2) ; 

a=(ml-(d2*b)) /dl; 

fprintf('\non solving these equations we get a=%5.2f & b=%5.2f\ 
n',a,b) 

fprintf('hence the required equation is: y = %5.2f +%5.2fx\ 
n’ ,a; 5b) 

end 


Computer Solution of Example 5.20 


Enter the No of Observations: -4 

Enter the different values of x:-[l1 2 3 4] 

Enter the Corresponding values of y [16 19 23 26] 
y=16 19 23 26 

The Observed Equations are: 

4.00a+10.00b=84.00 

*10.00a+30.33b=227.00 

On solving these equations we get a= 13.03 & b= 3.19 

hence the required equation is: y = 13.03 + 3.19x 


16.16 Newton’s Forward Interpolation Formula (Section 7.2) 


Flow-chart 
Refer to Section 14.16, page 714 
Program 


function []=Newtons Forward Interpolation _Formula() 
Che 
format compact 


MAXN=100; 
ORDER=4; 
nr=1;,dr=1; 
n=input ("Enter the value of n:-'); 
ax=input('Enter the values in form of x:-"'); 
ay=input('Enter the values in form of y:-'); 
disp ([ax' ayl]) 
x=input ('Enter the value of x for which value of y is wanted:-') 


h=ax (2) -ax(1); 
for i=l:n 
diff (i,2)=ay(i)-ay(i); 
end 
for j=3:ORDER+1 
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for i=l:n-j 
diff(i, j)-diff (i+1,j-1)-diff(i,j-1); 
end 
end 
i=1; 
while (~ (ax (i) >x) ) 
i=i+l; 
end 
i=i-1; 
p= (x-ax(i))/h; 
yp=ay (i); 
for k=2:ORDER+1 
nr=nr* (p-k+1); 
dr=dr-*'k; 
yp=ypt ((nr/dr) *diff(i,k)); 
end 


fprintf('S4.%f \n',yp) 
end 
Notes: MAXN is the maximum value of N 
ORDER is the maximum order in the difference table 
ax is an array containing values of x (x,, x,,....xn) 
ay is an array containing values of y Ce eesti) 
diff is a 2D array containing the difference table 
h is spacing between values of X 
x is value of x at which value of y is wanted 
yp is calculated value of Y 
nr is numerator of the terms in expansion of y_, 
dr is denominator of the terms in expansion o y,, 


Computer Solution of Example 7 


Enter the value of n:-6 
Enter the values in form of x:-[100 150 200 250 300 350 400] 
Enter the values in form of y:-[ 10.63 13.03 15.04 16.81 18.42 


19.90 22.27 

100 10.63 
150 13.03 
200 15.04 
250 16.81 
300 18.42 
350 19.9 

400 21.27 
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Enter the value of x for which value of y is wanted:-218 
x=218 15.0 


16.17 _Lagrange’s Interpolation Formula (Section 7.12) 


Flow-chart 
Refer to Section 14.17, page 714 
Program 
function[] = Lagranges Interpolation Formula () 
cle 
MAX=100; 


n=input ('Enter value of n:-'); 
ax=input{'Enter values of x:-'); 


ay=input{'Enter values of y:-'); 


x=input{'Enter value of which y is wanted:-'); 
y=0; 
for i=l:ntl 
dr=1; 
nr=1; 
for j=l:intl 
if (j~=i) 
nr=nr* (x-ax(j)); 
dr=dr* (ax(i)-ax(j)); 
end 
end 
y=yt ((nr/dr) *ay(i)); 
end 
fprintf('When x=%4.1f ,y=%4.1f \n',x,y); 
end 


Notes: MAX is the maximum value of n 

ax is an array containing values of x (x,, x,,....1n) 
ay is an array containing values of y (y,, y,,....¥Y,) 
x is value of x at which value of y is wanted 

y is calculated value of y 

nr is numerator of the terms in expansion of y 
dr is denominator of the terms in expansion of y 
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Computer Solution of Example 7.17 


Enter value of n:-4 

Enter values of x:-[5 7 1113 17] 

Enter values of y:-[150 392 1452 2366 5202] 
Enter value of which y is wanted:-9 

When x=9.0,y=810.0 


16.18 Newton’s Divided Difference Formula (Section 7.14) 


Flow-chart 
Refer to Section 14.18, page 716 
Program 


function [] = Newtons _ Divided- Difference Formula () 
cle 
n=input('Enter value of observation n:-'}; 


x=input('Enter values of x:-'); 


( 
( 
y=input ('Enter values of y:-'); 
("Enter value of which y is wanted:-'); 


for i=l:j 
f1l=f1* (k-x (1)); 
end 
£2-f£2+(y(1)*f1); 
n=n-1; 
(j=3+1); 
end 
f=f+f2; 
fprintf('f (%d)=Sd\n',k, f) 
end 


Computer Solution of Example 7.23 


Enter value of observation n:-5 


868 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


Enter values ofx:-[5 7 11 13 17] 

Enter values of y:-[150 392 1452 2366 5202] 
Enter value of which y is wanted:-9 

£ (9) =810 


16.19 Derivatives Using Forward Difference 
[Section 8.2] 


Formula 


Flow-chart 
Refer to Section 14.19, page 718 
Program 


function[]=Forward Difference Formula () 
Ele 

v=[0 0 1 1 11/12 5/6 137/180]; 

max=8; 
x=[L 1.1 1.2 1.3 1.4 1.5L i013 


y=[7.989 8.403 8.781 9.129 9.451 9.750 10.031]; 


xval=1.1; 


disp(['The values of x are: ', num2str(x)]); 
disp(['The values of y are: ', num2str(y)]); 
disp(['The value of x for evaluation is: ', 


for i=0<max 
if (x(it+l1)>=xval) 
pos=it+l; 


break; 
end 
end 
x0=x (pos) ; 
y0=y (pos) ; 
fprintf(' \n x0 is %f yO is %f at %d' , x0, 
h=x (2)-x{l); 
p=((xval-x0)/h); 
if (pos<max) 
fact=1; 
l=max-pos; 
fprintf('\n' ); 
for i=0<1 
for j=0:1 
tmp ((i+1) *1+(j5+1) )=0; 
end 


num2str{xval) ]) 


yO, pos) 


, 
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fprintf('\n') 
end 
fprintf('\n size of new array Sd \n',1); 
1=0; 

J=pos; 
while (i<1l) 
tmp (i+1l)=y (3); 
i=it+l; 
jaitl; 
end 
fprintf('\n'); 


for i=1<1 
for j=0<1 
tmp ((i+1) *1+(j+1)) =tmp ( (i) *1+ (442) ) -tmp ( (i) *1+ (541) ); 
end 
end 


fprintf('\n values are \n'); 
for i=0<1 
for j3=0<1 
fprintf{'Sf\t|',tmp((j+1) *14+(it1))); 
end 
fprintf('\n') 
end 
sum=0; 
k=1; 
for i=l<l 
sum=sumt ((1.0/ (i+1)) *tmp ( (itl) *1+0)) *k; 
k=-k; 
end 
fprintf('\n\n first (dy/dx):%f',sum/h) ; 
sum=0; 
fact=1; 
k=1; 
for i=2<1 
sum=sum+t (v ((it+1)) *tmp( (itl) *1+0) *k); 
k=-k; 
end 
fprintf('\n\n second (dy/dx): %Sf',sum/ (h%*2)) 
end 
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end 
Computer Solution of Example 8.1 


The values of x are: ‘| id d2 J3 ia 16 L6G 
The values of y are: 7.989 8.403 8.781 9.129 9.451 9.75 10.031 
The value of x for evaluation is: 1.1 

x, is 1.100000 y0 is 8.403000 at 1 

size of new array 6 

first (dy/dx): 3.952600 

second (dy/dx): —3.741200 


16.20 Trapezoidal Rule (Section 8.5-1) 


Flow-chart 
Refer to Section 14.20, page 724 
Program 


function[]=Trapezoidal Rule() 
format compact 
cle 


y=inline('1/(1+x.*x)'); 


( 
xO=input('Enter x0:'); 
xn=input('Enter xn:'); 
n=input('Enter no of subintervals:'); 


h=(xn-x0) /n; 

s=y (xO) ty (xn) ; 

for i=l:n-1 
s=st2.*y(x0+i.*h); 


end 
fprintf('The value of integral is: %f\n',h/2.*s) 
end 


NOTES: y(x) is the function to be integrated 
X18 x, 
cs 


Computer Solution of Example 8.10 (i) 


Enter x0:0 
Enter xn:6 


Enter no of subintervals:6 
The value of integral is:1.410799 
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16.21 Simpson’s Rule (Section 8.5-II) 


Flow-chart 
Refer to Section 14.21, page 736 
Program 


function[]=Simpsons Rule () 
one! 
y=inline('1/ (1+x.*x)'); 
x0=input (' ')3 
("Enter xn:'); 


Enter x0: 


xn=input (' 


n=input('Enter no of subintervals:'); 

h= (xn-x0) /n; 

s=y (x0) +y(xn)+4.*y(xO0th) ; 

for 1=3:2:n-l1 
s=st+4.*y(x0+i.*h)+2.*y(x0+(i-1).*h); 

end 


fprintf('The value of integral is: %f\n',h/3.*s) 


NOTE: y(x) is the function to be integrated so that yi = y(y,) = y(x, + i*h) 


Computer Solution of Example 8.10 (ii) 


Enter x0:0 
Enter xn:6 


Enter no of subintervals:6 
The value of integral is: 1.366173 


16.22 Euler’s Method (Section 10.4) 


Flow-chart 
Refer to Section 14.22, page 727 


Program 


function[]=Eulers Method () 
format compact 

format 

cle df=inline{'xty'); 


xO0=input(' Enter value of x0:-'); 
yO=input ('Enter value of y0:-"'); 
h=input ("Enter value of h:-'); 
x=input('Enter value of x:-'); xl=x0; 
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yl=y0; 
while (x>x1l 

yl=ylth.*df(xl,yl); 

xl=xlth; 

fprintf('When x=%2.2f y=%2.2f\n',xl,yl) 
end 


end 


NOTE: df(x, y) is dy/dx 
A ISOC rank Canc 

x; is Mil 

Yo is Ynso 1.€., Y,, 

y, is ynt] 


Computer Solution of Example 10.8 


Enter value of x0:-0 
Enter value of y0:-1 
Enter value of h:-0.1 


Enter value of x:-l 


When x=0.10 y=1.10 
When x=0.20 y=1.22 
When x=0.30 y=1.36 
When x=0.40 y=1.53 
When x=0.50 y=1.72 
When x=0.60 y=1.94 
When x=0.70 y=2.20 
When x=0.80 y=2.49 
When x=0.90 y=2.82 
When x=1.00 y=3.19 
When x=1.10 y=3.61 


16.23 Modified Euler’s Method (Section 10.5) 


Flow-chart 
Refer to Section 14.23, page 729 


Program 


function[]=Eulers Method() 
format compact 

format short g 

ele 

df=inline('xty'); 
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xO=input ("Enter x0:'); 


yO=input{'Enter y0O:'); 
h=input{'Enter h:'); 


x=input('Enter x:'); 
xl=x0; 
yl=y0; 
while (1) 
if (x<x 1) 
return; 
end 
yl=ylth.*df(xl,yl); 
xl=xlth; 
fprintf ('When x=%3.1f y=%a4.2f\n',xl,yl) 
end 
end 


Computer Solution of Example 10.10 


Enter x0:0 
Enter yO:1 


Enter h:0.1 
Enter x:0.3 
Whenx=0.1 y=1.10 
Whenx=0.2 y=1.22 
Whenx=0.3 y=1.36 


16.24 Runge-Kutta Method (Section 10.7) 


Flow-chart 
Refer to Section 14.24, page 732 
Program 


function[]=Runga_Kutta_Method() 
CLs? 

format compact 

format short g 
f=inline{'xty*y'); 


xO0=input ("Enter the value x0:'); 
yO=input ('Enter the value y0:'); 
h=input('Enter the value h:'); 
xn=input ('Enter the value xn:'); x=x0; 


y=y0; 
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while (1) 
if (x==xn) 
break 
end 
kl=h*f (x,y); 
ea ytk1/2); 
k3=h* f (xth/2, yt+k2/2) ; 
k4=h* f (xth, y+k3) ; 
k= (k1+ (k2+k3) *2+k4) /6; 
x=xth; 
y=ytk; 
fprintf('When x=%f y=%f \n',x,y) 
end 


end 


NOTES: x, is starting value of x, i.e., x, 
x, is the value of x for which y is to be determined 


Computer Solution of Example 10.15 


Enter the value x0:0 

Enter the value y0O:1 

Enter the value h:0.2 
Enter the value xn:0.2 
When x=0.200000 y=1.273536 


16.25 Milne’s Method (Section 10.9) 


Flow-chart 
Refer to Section 14.25, page 734 
Program 


function, []=Milne Method () 
CAG 
format compact 
format short g 
global x y; 
global h 
x=[0 00 0 0 J; 
=[0 0 0 0 OJ]; 
x(1)=input('Enter the value x0:'); 
xr=input('Enter the last value of x:'); 
h=input{'Enter the spacing value:'); 
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aerr=input ('Enter the allowed error:'); 
y=input ("Enter the value of y(i),i=0,3:-'); 
for i=1:3 


x (i+1) =x (1)+i*h; 

x (2:3, 2)=x(2:3;,23)+x(1,1)*6 
end 
disp('x Predicted Corrected"); 
disp('y f y £"); 


while (1) 
if (x (4) ==xr) 
return 
end 
x(5)=x (4) th; y(5)=y{1)+(4*h/3) * (2* (£ (2) +£(4) )-£(3)); 
fprintf('Sf Sf % Vn, 3¢5) ~ VS); £(5). JF 
correct (); 
while (1) 
yo=y (5); 


corect(); 
if (abs (yc-y (5) <=aerr) ) 


break; 
end 
end 
for i=1:4 
(4) =x (itl); 
y(i)=y (itl); 
end 


end 
function [z]=f (i) 
z=x(1i)-y(i) *y (i); 
end 
function[]=correct () 
y (5) =y (3) + (h/3) * (£ (3) +4* £ (4) +£(5)); 
fprintf('Sf Sf\n', y(5),£(5)) 
end 
end 
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NOTES: x is an array such that x[i] represents x, , , for e.g., x[0] represent 
x), 

y is an array such that y|i] represents y_, , 

xr is the last value of x at which value of y is required 

h is spacing in values of x 

aerr is the allowed error in value of y yc is the latest corrected value for y 
f is the function which returns value of y’ 


correct calculates the corrected value of y and prints it 


Computer Solution of Example 10.19 


Enter the value x0:0 

Enter the last value of x:1 
Enter the spacing value:0.2 
Enter the allowed error:0.0001 


Enter the value of y(i),i=0,3:-[0 0.2 0.0795 0.1762] 
x Predicted Corrected 
y £ y £ 
0.800000 0.283794 0.719461 0.305430 0.706712 

0.304580 0.707231 
0.304615 0.707210 

1.000000 0.635420 0.596241 
0.442469 0.804221 
0.456334 0.791759 

16.26 Adams-Bashforth Method (Section 10.10) 
Flow-chart 


Refer to Section 14.26, page 736 


Program 


function[]=Adams_ Bashforth Method () 
cle 

format compact 

format short g 

x=input{'Enter Values of x\n'); 


y=input ("Enter Values of y\n'); 
Sz=size (x); 

SZ=Sz (2); 

h=x (2)-x(1); 

for i=l:sz 
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tx=x (i); 
ty=y (i); 
ti=(tx*2*{1.0+ty)); 


end 

for i=l:sz 

x(1); 

y(i); 

fa) 3 

end 

x(szt1)=1.4; 
y(szt+1)=y(sz)+(h/24) * ((55*£ (sz) )-(59*£(sz-1))+(37*£ (sz-2))- 
(9*f<sz-3)); 

f(sz+1)=(x(szt+1)%*2)* (1.0+y(szt1)); 

for i=l:sztl 

fprintf ('x=%4.1f yod=%4.3f £3d=%4.5f\n',x(i), T= SzZy7y (1) p4= 
$2, £.(2)") 

end 


end 
Computer Solution of Example 10.23 


Enter Values of x 

(it. Bel, T2134 

Enter Values of y 

[1 1.233 1.548 1.979] 


x=1.0 y-3=1.000 £-3=2.00000 
x=1.1 y-2=1.233 £-2=2.70193 
x=1.2 y-1=1.548 f-1=3.66912 
x=1.3 yO=1.979 £0=5.03451 
x=1.4 yl=2.572 £1=7.00170 


16.27 Solution of Laplace’s Equation (Section 11.5) 


Flow-chart 
Refer to Section 14.27, page 740 


Program 


function[]=Laplace Equation () 
global SOR u 

ele 

SQR=4; 
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u=zeros (SQR); 


disp('Enter the boundry conditions') 


getrow(1,u); 
getrow(SQR,u) ; 
getcol(1,u); 
getcol (SQR,u); 
aerr=.1; 
maxitr=10; 
for itr=l:maxitr 
maxerr=0; 
for 1=2:SQR-1 
for j=2:SQR-1 
t=(u(i-1,j)tu(itl,4)+u(i,jt+l1)+u(i,j-1))/4; 
err=abs (u(i,j)-t); 
if (err>maxerr) 
maxerr=err; 
end 
u(i,j)=t; 
end 
end 
fprintf('iteration No.%d \n',itr); 
disp (u) 
if (maxerr<=aerr) 


fprintf('After %d iterations \n the solution 


Nn! y cite) 
disp (u) 
return 
end 
end 
function[]=getrow(i,u) 
global u 


fprintf('Enter the values of u[%d,j],j-1,%d \n',i,SQR); 


for j=1:SOR 
u(i, j)=input (''); 
end 
end 
function []=getcol(j,u) 
global u 


fprintf{'Enter the values of u[i,%d],i=2,%d \n',j,SQR-1); 


for i=2:SQR-1 
u(i,j)=input{''); 
end 


is 
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end 
end 


NOTES: SQR is the size of the square mesh 

u is a 2D array representing the square mesh 

aerr is allowed error 

maxitr is the maximum number of iterations to be performed 

itr is the counter which keeps track of number of iterations performed 
err is the error in a particular point of the mesh 

maxerr is maximum error in the mesh in an iteration 

f is the execution time format 

getrow inputs the ith row of the mesh 

getcol inputs the jth column of the mesh 


Computer Solution of Example 11.3 (a) 


Enter the boundry conditions 


Enter the values of u[1,j],j=1,4 
The elements of the matrix 1000 
The elements of the matrix 1000 
The elements of the matrix 1000 

e 


he elements of the matrix 1000 


Enter the values of u[4,j3],j=1,4 


The elements of the matrix 1000 
elements of the matrix 500 

The elements of the matrix 0 
elements of the matrix 0 


Enter the values of u[i,1],i=2,3 
The elements of the matrix 2000 
he elements of the matrix 2000 


p 


Enter the values of u[i,4], i=2,3 


m 


he elements of the matrix 500 


The elements of the matrix 0 
iteration No. 1 


1.0e+003 * 
1.0000 1.0000 1.0000 1.0000 
2.0000 0.7500 0.5625 0.5000 
2.0000 0.8125 0.3438 0) 
1.0000 0.5000 0) 0 


880 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


iteration No. 


1.0e+003* 

1.0000 
2.0000 
2.0000 
1.0000 


iteration No. 


1.0e+003* 

1.0000 
2.0000 
2.0000 
1.0000 


iteration No. 


1.0e+003 * 
1.0000 
2.0000 
2.0000 
1.0000 


iteration No. 


1.0e+003 * 
1.0000 
2.0000 
2.0000 
1.0000 


iteration No. 


1.0e+003 * 
1.0000 
2.0000 
2.0000 
1.0000 


iteration No. 


1.0e+003 * 
1.0000 
2.0000 
2.0000 
1.0000 


iteration No. 


1.0e+003 * 
1.0000 
2.0000 
2.0000 
1.0000 


OrRrRER OrRrrRER 


OrRrRER 


.00 
.09 
-98 
-50 


oe Oo 


.00 
oA 
02 
-50 


OrRrRER 


.00 
-20 
203 
-50 


OrRrRER 


0000 
-2065 
.0408 
- 5000 


0000 
-2079 
-0414 
- 5000 


0000 
2082 
-0416 
- 5000 


0000 
2083 
-0417 
- 5000 


oO OCOF oO OCOF 


oOo FF 


0000 
- 5000 


0000 
- 5000 


0000 
- 5000 


Numerical MetHops Usinc Matias ¢ 881 


After 8 iterations the solution is 


1.0e+003* 
1.0000 1.0000 1.0000 1.0000 
2.0000 1.2083 0.7917 0.5000 
2.0000 1.0417 0.4583 0 
1.0000 0.5000 0) 0) 


16.28 Solution of Heat Equation (Section 11.9) 


Flow-chart 
Refer to Section 14.28, page 745 


Program 


function []=Heat_Equation () 
CLES 
format compact 
format short g 
XEND=8 ; 
TEND=5; 
u=zeros (XEND+1, TEND+1) ; 
h=1.0;k=0.125; 
f=inline('4.*x-(x.*x)/2. 0); 


csqr=input (‘Enter the square' of c:\n'); 
alpha=(csqr.*k)/(h.*h); 

ust=input('Enter the value of u[0,t]:'); 
fprintf('Enter the value of u[%d,t]\n',XEND); 
uet=input (''); 

for j=1:TEND+1 


u(XEND,j)=ust; 
u(1,3) =u (XEND, 3); 


end 
for i=1:XEND-1L 
u(itl,1)=f (i); 
end 


for j=1:TEND 
for i=2:XEND 
u(i,j+1)=alpha*u(i-1,j) + (1-2*alpha) *u(i,j)+alpha*u(i+l,j); 
end 


end 
fprintf('The value of alpha is %4.2f\n1,alpha) 
disp('The value of u(i,j) are:-"') 


882 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


disp(u'); 
end 


NOTES: XEND is the ending value of x 
TEND is the ending value of t 

h is the spacing in values of x 

k is the spacing in values of y 

f(x) is value of u(x, 0) 

csqr is value of C? 

alpha is a 

ust is the value in first column 

uet is the value in the last column 


Computer Solution of Example 11.11 


Enter the square of c:4 

Enter the value of u[0,t]:0 
Enter the value of u[8,t] 0 
The value of alpha is 0.50 


The value of u(i,j) are:- 
Columns 1 through 7 


0 Sees) 6 7145 8 vans) 
0 3 Dig 7 725 7 
0 VA A) 5 6.5 7 6.9 
0 255 4.625 6 6.5 6 
0 2.3125 4.25 5.5625 6 5.5625 
0 2.125 3.9375 5125 5e9025 5125 
Columns 8 through 9 

335 0 
3 0 

2.15 0 

24:5 0 

2.3125 0 

2<125 0 


16.29 Solution of Wave Equation (Section 11.12) 


Flow-chart 
Refer to Section 14.29, page 748 


Program 


function[]=Wave Equation () 
ole 


6 
Diao) 
5 
4.625 
4.25 
3.9375 


XEND=5; 
TEND=5; 
f=inline('x 


( 


ww 


csqr=inpu 


ust=input(' 


( 
fprintf('En 
uet=input ( 
for j=1:TEN 
u(1,j)= 
u (XEND+ 


for i=1:XEN 
u(itl,1l 
u(itl,2 


for j=2:TEN 
for i=2 


u(i, 
end 


end 
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*x* (S-x) 1); 


Enter the square of c\n'); 

Enter the value of u[0][t]\n'); 
ter the value of u[%d][t]\n', XEND) 
"); 

D+1 

ust; 

1,3) =uet; 


D-1 
)=£(4); 
)=£(4); 


D 
: XEND 
jt1)=u(i-1,j) tu(itl,j)-u(i,j-1); 


NOTES: XEND is the ending value of x 
TEND is the ending value of t 
f(x) is value of u(x, 0) 


csqr is value 
ust is the val 


uet is the value in the last column 


of C? 


ue in first column 


Computer Solution of Example 11.14 


ans = 


HN oF BD 


=2 
-16 


Ooo @ 0 0 & 


Enter the value of u[5j[t] 


Enter the square of c 16 
Enter the value of u[0][t] 


0 

0) 
12 18 16 0) 
12 18 16 0) 
10 10 2 0) 
6 -6 =6 0 
-10 -10 -8 0 
-18 -12 -4 0) 
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16.30 Linear Programming-Simplex Method (Section 12.8) 


Flow-chart 
Refer to Section 14.30, page 750 
Program 


function [ ]=Linear Programming Simplex Method () 
Ce 

ND=2; 

NS=2; 

N=ND+NS; 

N1=NS* (N+1) ; 

c=zeros (1,N); 

cb=zeros(1,NS); 


th=zeros(1,NS); 
x=zeros(1,ND); 

a=zeros(NS,N+1l); 
bas=zeros{1,NS); 
for i=1:NS 
a(i,i+ND)=1.0; 


end 
for i=1:NS 

bas (1) =i+ND; 
end 


= 


disp('Enter the constraints') 


for i=1:NS 
for j=1:ND 
a(i, j)=input (''); 
end 
a(i,Nt+l)=input (''); 
end 


disp('Enter the objective function") 
for i=1:ND 
c(i)=input(1"'); 


end 

while (1) 
max=0; 
kj = 0; 
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for j=1:N 
z=0; 
for i=1:NS 
z=ztcbh (i) *a(i, Jj); 
end 
cj=c(j)-z; 
if (cj>max) 
max=Cj; 
kj=J; 
end 
end 
if (max<=0) 
break; 
end 
max=0; 
for i=1:NS 
if (a(i,kj) ~=0) 
th(i)=a(i,N)/a{i,kj); 
if (th (i) >max) 
max=th (i); 
end 
end 
end 
if (max<=0) 
disp ('Unbounded solution'); 
return; 
end 
min=max; 
ki=1L* 
for i=1:NS 
if ((th(i)<min)& & <th(i)~=0) ) 
min=th (i); 
ki=1% 
end 
end 
t=a(ki, kj ); 
for j=1:N+1 
a(ki,j)=a(ki,j)/t; 
end 
for i=1:NS 
if (i~=ki) 
b=a(i,kj); 
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for k=1:N+t1 
a(i,k)=a (i,k)-a(ki,k) *b; 
end 
end 
end 
cb (ki) =c (kj); 
bas (ki) =kj; 


end 
for i=1:NS 
if ( (bas (i) >=0) && (bas (i) <ND) ) 
x (bas (i))=a(i,N); 
end 
end 
z=0; 
for i=1:ND 
zZ=zt+c(i)*x(i); 
end 
for i=1:ND 
fprintf ('X(%Sd)=%7.2f \n',it1l,x(i)) 
end 
fprintf('Optimal value =%7.2f \n',z) 
end 


NOTES: ND is the number of decision variables 

NS is the number of slack variables 

a is the array containing body matrix, unit matrix and bi’s 

c is an array containing values of cs 

cb is an array containing values of C 5 

th is an array containing values of e’s 

bas is the basis. For x,'s basis contains i, for s,’s basis contains i+ND 
ki is the key row 

kj is the key column 


Computer Solution of Example12.4 


Enter the constraints 

4 

2 

80 

2 

5 

180 

Enter the objective function 
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3 
4 
X(1)= 2.50 
X(2)= 35.00 


Optimal value = 147.50 


Computer Solution of Example 12.16 


Enter the constraints 
2 


40 


BPW oO fF BN W 


30 
Enter the objective function 


3 
6 
X(1)= 0.00 

X(2)= 42.22 

X(3)= 156.67 

Optimal value= 1066.67 


Exercises 16.1 


1. Letx = [1234]. 
(a) Add five to each element 
(b) Add three to just the even-index elements 
(c) Compute the square root and square of each element 
2. Create the vector x = randperm (50) and then evaluate the following 
function using only logical indexing: 
yx) =2ils <8 


=x-9if9<=x<35 


3. Create a vector x with the elements, 


x = (-1)"*! (Qn 1) 


888 


7. 


8. 


10. 


11. 


12. 


13. 


14. 


15. 
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. Given the arrays x = [1 23], y = [245] and A = [38 6;5 43], find 


(a)x+y (b) [x; y’] (c) x; y] (d)A-38 


. Write a MATLAB code to plot the function 


y =x°—x? + 6x sin (5x) — Ox 


. Write a MATLAB program to evaluate the roots of the equation ax? + 


bx +c=0. 


Write a program in MATLAB for finding a real root of the equation 
f(x) = 0 by the bisection method. 


Write a MATLAB program to find a real root of x3 — 4x — 9 = 0 using the 
method of false position. 


. Write an algorithm for the Newton-Raphson method to solve the equa- 


tion f(x) = 0. Apply the same to solve cos « — xe* = 0 near x = 0.5 correct 
to three decimal places. 


Write a MATLAB program to solve the following equations by the 
Gauss-Seidal method: 83x + lly — 4% = 95; 7x + 12y + 13z = 104; 

3x + 8y + 20% = 71. 

With the help of a flow chart, write a MATLAB program to solve: 
7.x + 3.8y + 2.9% = 15; 3.2" + 6.8y + 7.4% = 37; 1.3x + 2.1y + 3.2% = 7, 
using the factorization method. 


Given the data: 


x 5 10 15 20 25 30 


y 17 95 30 33 36 38 
Write a MATLAB program to fit a quadratic relation using least square 
criterion. 


Write a program in MATLAB to estimate f(0.6) by the Lagrange inter- 
polation for the following values: 
x 0.4 05 0.7 
fix) —0.916 —0.693 —0.357 —0.223 
10 
Write a MATLAB program to evaluate f x(x* +x)dx using Simpson's 
rule. 2 


4 
Write a MATLAB program to evaluate i f(x) using the Simpson’s 3/8 
rule. a 


16. 
17. 


18. 


19. 


20. 
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Write a MATLAB for the second order Runge-Kutta method. 


Write a MATLAB for solving differential equations using the Runge- 
Kutta fourth order formulae. 


Write a MATLAB program to find y(0.8) for the differential equation 
dy/dx = a(x + y) Given the following table using Milne’s Predictor- 
Corrector method: 
x 0 0.2 0.4 0.6 

y 2 2.636 3.595 4.968 
Write a MATLAB program to maximize z = 6x, + 4x, subject to 2x, + 3x, 
< 100, 4x, + 2x,< 120, x,, x, 20 where x1, x, are number of items to be 
produced. 


Write a MATLAB program to solve Example 12.17. 


APPENDIX 


USEFUL INFORMATION 


| Basic Information and Errors 


1. Useful Data 
e = 2.7183 1/e = 0.3679 log, 2 = 0.6931 log. 3 = 1.0986 


mz=3.1416 | I/t=0.3183 log, 10 = 2.3026 log,) e = 0.4343 


V2 =1.4142 | J3 =1.732 1 rad. = 57° 17’ 45” | 1° = 0.0174 rad. 
2. Conversion Factors 

1 ft. = 30.48 cm = 0.3048 m 1m = 100 cm = 3.2804 ft. 

1 ft? = 0.0929 m? l acre = 4840 yd? = 4046.77 m? 

1 ft = 0.0283 m3 1m? = 35.32 ft 

1 m/sec = 3.2804 ft/sec. 1 mile/h = 1.609 km/h. 
3. Some Notations 

E belongs to U union 

Ez doesnot belong to a intersection 

= | implies 3/ such that 

© | implies and implied by 


Factorial n, i.e.,n | =n(n —1) (n—2)--- 3.2.1. 


Double factorials: (2n)!! = 2n(2n — 2) (2n — 4) --- 6. 4. 2. 
(2n — 1) I! = (Qn — 1) (Qn — 3) (Qn —5)--- 5.3.1. 


Stirling’s approximation. When n is large n! ~ J/2an-n"e" . 
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4. If X is the true value of a quantity and X’ is its approximate value, then 
(i) Absolute error = |X — X’| 


x= XxX’ 
Xx 


(ii) Relative error = | 


A=X’ 
X 


(iii) Percentage error = 100 


5. If Ay is the error in the function y = f(x, x,,---, x,) corresponding to the 
errors Ax,, Ax)-++> Ax,, then 
oy = cee + MY i aBiaek Bt. 
Oxy OX ox 
6. Relative error of a product of n numbers 
= Algebraic sum of their relative errors approximately 


n 


Il Solution of Algebraic and Trancendental Equations 


1. Intermediate value property: If f(x) is continuous in the interval [a, b] 
and f(a), f(b) have different signs, then the equation f(x) = 0 has at least 
one root between x = a and x = b. 


2. Descartes rule of signs: The equation f(x) = 0 cannot have more posi- 
tive roots than the change of signs in f(x) and cannot have more negative 
roots than the change of signs in f(—). 


3. If @,, Gs, Az,--- be the roots of the equation a,x" + a,x"! + ayx"? + ayx’? 
pp A, G3 ox 1 2 3 


+... =0, then 
ay ag a3 
a a4 a 


1 
4. Bisection method: Iteration formula is *3 = re ae ro) 


This process is continued till the difference between two consecutive 
values is negligible. 


5. Method of false-position or Regula falsi method: Iteration formula 
is 


Xy =X — 


A (x0) 

F(x)— f(x) ° 

This process is repeated till the difference between two consecutive val- 
ues is negligible. 
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6. Secant method: 


Iteration formula is x3 =x, — 


Foe TGs) hss ) 


Obs. If secant method once converges, its rate of 
convergence is 1.6 which is faster than that of method of 
false position. 


NOTE 


7. Iteration method: Writing f(x) = 0 as x = ¢(x) and taking x, as the initial 
root of the given equation, the approximations to the root are x; = o(x,) 
such that @’(x) < 1. 


8. Newton-Raphson method algorithm is 


f(x,) 
ac 
Obs. Condition for its convergence is | f(x) f(x) | < | f’ Go) 
|2. Newton’s method has a second order of convergence. 


If this method once converges, it converges faster than the 
Regula-falsi method and is preferred. 


Xnt1 = Xn 


NOTE 


9. Iterative formula to find I1/N is x, = x, (2—Nx,) 


1 
10. Iterative formula to find JN is *,4, = alin +N/x,) 


11. Method of Least squares: (i) Curve of best fit y = a + bx 
Normal equations: Xy = na + b&=x, Uxy = aXx + bux? 
To find a, b, solve these equations. 
(ii) Curve of best fit y = a+ bx + cx? 
Normal equations: Xy = na + b&x + cXx? 
xy = alx + DEX + cx’, Dy = aEx? + bE + cd’. 
To find a, b, c, solve these equations. 


IIl_ Solution of Simultaneous Algebraic Equations 


1. Numerical solution of linear simultaneous equations are 
(i) Direct methods (ii) Indirect (or Iterative) methods 
Method of Determinants, Matrix Inversion method, Gauss-elimination 
method, Gauss-Jordan method and Factorization method are direct 
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methods; Gauss-Jacobi method, Gauss-Seidal method, and Relaxation 
methods are indirect methods. 


2. Method of determinants—Cramer’s rule. For the equations 
ayx+b,y+c,% =d,, dyx + byy + €y% = ds, a3x + by + 632 = ds, 


i d, b « ; aq d, c a db, d, 
d, bs 3 ad; d3 C3 ad; b; ds 
a, by 2% 


where A=|a, by. Cg 
a, bz ¢3 
3. Matrix Inversion method. For the equations: 
ayx+b,yt+c,% =d), dyx + byy + €y% = ds, a3x + by + 632 = ds, 


aq b G x d, 
if A=|a, by cy|,X=|y|andD=|d, 
a, bs Cs Zz ds 
A; A, Aj] | dy) 
then X=ly =a B,. By Bs (Xd; 
7 C, GC, Cs ds 


where Aj, Bj, etc. are the cofactors of a,, b, etc. in the determinant | A |. 


4. Gauss-elimination method. In the Gauss elimination method, the 
coefficient matrix is transformed to upper triangular matrix. 


5. Gauss-Jordan method. In Gauss-Jordan method, the coefficient ma- 
trix is transformed to diagonal matrix. 


6. Gauss-Jordan method of finding the inverse of a matrix A. The matri- 
ces A and | are written side by side and the same row transformations are 
performed on both. As soon as A is reduced to J, the other matrix repre- 
sents 4! 


7. The convergence in Gauss-Seidal method is thrice as fast as in 
Jacobi’s method. 


8. The condition for Gauss-Jacobi’s method to converge is that the 
coefficient matrix should be diagonally dominant. 
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IV Finite Differences and Interpolation 


1. 


Vv 


Forward differences: Ay, = y,..; —y,. 
Backward differences: Vy, =y,—y,., 
Central differences: Ay,.1 =y,—).1 


. Relations between operators: 


i) A=B=1 (ii) V=1-FE! 
1 ‘ 15s 
(iii) A= Fl? — Fo12 (iv) = 5(e” +E ue 
(vy) A=EV=VE=AE"” (vi) E=e? 


. Factorial notation. The product x(x — 1) («—2) --- (@—r + 1) is denoted 


by [x]" and is called a factorial. 

Factorial polynomial is defined as [x]" = x(x — A) (x — 2h)--- [x — 
(n — 1)h]. The result of differencing [x]" is analogous that of differ- 
entiating x’. 

Important Result 


A[x]" = nlx] 
Afax + b]" =na [ax + b]""! 


. Reciprocal Factorial notation. The function {(x + h)(x + 2h)... (x + 


nh)" is denoted by [x}" and is called a reciprocal factorial function. 
Important Result 
A[x}® =— n[x}pe 
Afax + b]" =~ na [ax + by") 


. Inverse Operator of A. /fAy, = v,, then y, = A‘ u,, A‘ or 1/A is called 


the inverse operator of A and is analogous to 1/D or integration in calcu- 
lus. 


Important Result 
A [ay =_ Elia + 1) 
AS [xl = [xp vr n + 1) 


Interpolation 


1. Newton’s forward interpolation formula: 


p(p-1)(p-2) 
3! 


p(p-1) 
21 


Yp = Yo + pAyo + A* yy + Nee 


where p = (x —Xo)/h. 
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2. Newton’s backward interpolation formula: 


Yp = Yn + PVYn Peony, PE HNO +8) yoy, Pik 


where p = (x —x,)/h 


3. Gauss forward interpolation formula: 


(p—D 5 (ptDp-V 
yp = Yo + pAyy + A*y., + 


+1)(p-V(p—2 
pti)(p-1)(p Ady, — 
4! = 
4. Gauss’s backward interpolation formula: 


A*y, 


, 


(p+l)p .. (p+ 1)(p-1) .. 
Yp = Yo + pay.) +E a Paty. +o Ff — “i A*y_5 
+2)(p+I(p-1 
ae wes ioe ee oe 
5. Stirling’s formula: 
Ay, + Ay_ a p(p?-1) A?y_, + A°y_. 
=m to Wot tot) ty + : wat Y-2 
2/2 
P (p -1) 4 
+ i A Ycg He" 


6. Bessel’s formula: 


(p= 1) A°y. +A’ yy | (p= 3)p(p-1) 


Yp = Yo + pAyo + E 2) py) 3! Mya 
(+ p(p- (p= 2) Aty2 +Aty 
4) 2 -_ 
7. Laplace-Everett’s formula: 
272 ={2\o2 92 
pee dnty 42 Ja daly gto. 
oly? —12 2_ 42 2_ 92 
+py, HY) ay, + p(p te A‘y 1 +...[q= 1-p| 
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8. Lagrange’s interpolation formula: 


(x—x, )(x-—x)...(x-2,) (x xy )(x-x5 bcs 
Xo — x, )(xq 45) oAm T Xn 
(= 2,)@5a) lee) 


><. ———... 
n 
(x, xo (x, x )...(%tq fis) 


— 
— 
— 
2 | a 
ea 
— 


9. Lagrange’s inverse interpolation formula: 


(Yo — 9 (Yo — ye)---(Yo — Yn) : (4: — yo (1 —y2)---(y1 - Ya) ; 
(y-4o)(y-1)---(y- Yn) 


++ Xp. 
(y, = yy (yy ~y,)..Ay, ~y,-1) 


10. Newton’s divided difference formula: 


V=f(X) = Vo + (% — Xo) [X05 X1] + (& — Xp) & — 2X1) Xo, X15 X2] 


(= Fy) (= Hj) Ag) [egy Bey Hay Hq 


11. Hermite interpolation formula: 


P(x) = [1 — 2(% — X9) Lo o)] [Lo GP VO%o) + & — Xo) Lo CP VO) 
+[1-—2@- x) Ll", &)] Li (x)]}? OX) + (x-x)) [L,(x)P y¥) 
+ [1 — 20 — xp)L’y %)] LLoQ)P yo) + (= x2) [LiQ)P 2) +. 


12. Cubic Spline interpolation formula: 


Vi 


1 3 3 
fo)= | (en —x) M, +(x-x;) Mia | 
2 


Peal —x) say +(x—3;) iy 
h Xin TX) Yj ae X~ Xi) Yin 6 itl 


6 
where M,_; +4M,+Mji; =55 Yin — 2y; + yi41).i =1,2,3,...,(n-1) 
and M, = 0, M, = 0. 


Numerical Differentiation 


1. Forward difference formulae: 


dy 1 1. 1 1. 
& | a ES “3 Nyy 3 f Mo 7h vo +. 


dt i ll 
(<4 = ss | Aa a A* yo ag 1p) Yo a | and so on. 
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2. Backward difference formulae: 


dy i |e ee a 
| =—|Wy, +—V’y, +-V°y, +—V‘y, +... 
| dx } h l n 9) n ie) Yn 4 Yn 


d° fs 
J} = ahaa +V°y, + Ne + es and so on. 
dx . h- 12 
3. Central difference formulae: 

(i) Stirling’s formula gives 


( = ee 1 1A‘y i tA*y 2, 1A’ 2tA’y By | 


dx h 2 6 2 30 2 


d°y aie tt a La 
(s | = 74% 1~qg hy ato Ayy =| 


(ii) Bessel’s formula gives 


dy 1 1 A*y- + A* yo La 
(=) =i [10-3 D Paget 
1 (A’y_.+A*y_,) 1 
+ 2 -—Ay, ++ 
12 2 12 


ra l (“2 tA] ee: [Mes aaa 


dx? h2 2 9° F179 2 


0 


1 
teh’ y-2 + 


Vil Numerical Integration 


1. Trapezoidal rule: 


lia f(xdx = “[(v + y,)+2(y, + yo +--+ y,-1)| 


*Q) 


2. Simpson’s 1/3rd rule: 


ia (x)dx =F [yo - Ind Ay +Yy3 +o+y, 1) 


+2(y, ty, +--+ y,-2) | 


(Number of sub-intervals should be taken as even) 
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3. Simpson’s 3/8th rule: 
Xytnh 3h 
f. F(x)dx=—=[(yo + yn )+3(y, + Y2 +44 +45 +0 + Yn-1) 


+2(y5 + YG es ns) | 
(Number of sub-intervals should be taken as a multiple of 3) 


4. Boole’s rule: 


Xg+nh oh 
f f (x)dx = mre + 32y, +12y, +32y, +14y, 


+32y, + 12y_ + 32y, +14y, +---] 
(Number of sub-intervals should be taken as multiple of 4) 
5. Weddle’s rule: 


Xo tnh _ 3h 
i, Plaids 7 ma 


(Number of sub-intervals should be taken as a multiple of 6) 


Yo + 5y, + Yo +6y3 + yy + 5y5 + 2y, + 5y, +...] 


6. Errors: 


Rule No. of intervals Error Order of error 
(multiples of) 
Trapezoidal Any h2 h? 
— Ty y ” 
Simpson's 1/3 2 i ; ht 
— 7 y Ww 
Simpson's 3/8 3 sh > h? 
50 Y 
Weddle’s 6 ies hi 
140 yo 


7. Romberg’s method: 
I(h,h/2)= Sanh /2)-1(h)) 


The computation is continued till two successive values are equal. 
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8. Gaussian integration: 


(i) Two point formula: f flxdx = s(3)+ s(=5] 


(ii) Three point formula: fi foods = ~f(0) + 4-8) i al 


(iit) To apply Gaussian integration, the limits of integration a, b are 


1 1 
changed to — 1, 1 by the transformation * = Fic —a)ut 3? +a). 
9. Double integration: 
(i) Trapezoidal rule: 


r=" [( f+ fon) #2( for + fiat fom) 
+( foot fom) +2(fu + faa +--+ fam-1) | 
aS fot fin) + 2( fa + fs ++ fina) jp 


where f,, = f(x; y;) 
(ii) Simpson’s rule: 


J, So f(x y)dxdi a “Ti 1,j-1 + Af, Lj a5 f; Ljt :) 


+4( fi, + Afi; + Afi jst ) + Cee + A fist - fis je )| 
Adding all such intervals, we get I. 


Vill Number Solution of Ordinary Differential Equations 


1. Picard’s method: y. = y +f f(xy dx 


Yo = Yo + f° f(x.m)ax ete. 


2. Taylor’s method: 


iv Xo : 
af 
3. Euler’s method: 1, = y, + hf(xo + h, y;) 


Y=Yor +(x — xo (yo + 


Repeat this process till y, is stationary. Then calculate y; and so on. 
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h 
4. Modified Euler’s method: y. = y; + 5Lf (xo thy, )+f (xo + 2h, ys ) 
Repeat this step, until y, becomes stationary. Then calculate y3 and so on. 
5. Runge Kutta method: y, = y, +k, where k= alk +2k, + 2k, + k,) 


such that = f(x, Yo), ky = hf (xo + h/2, yo + ky) 
: oe Yo + k,/2), ky = hf(xo + h, yo + ks) 


6. Milne’s method: 
4h 
(i) Predictor formula: y4 = Yo + = (2 i took +2f;) 


(ii) Corrector formula: y, = +h +4 fs; +f,) 
7. Adams-Bashforth method: 
h 
(i) Predictor formula: y; = Yo + 54 (55f0 —59fg, +37f .-9fF a] 


h 
(ii) Corrector formula: y; = yo + gh +19f,-9f-; + 73) 


(Four prior values are required to ve the next values by Milne’s or Ad- 
ams-Bashforth method) 


8. Central-difference approximations: 
j 1 
y= ay (yet _ yin) 
1 
yy = 7 (vie —2Qy;, +4 a 


1 
Ys ~ ons (Yin - — 2Yj4) + 2y;4 — yi-2) 
iw 1 
yn = Ae —4yi41 + Gy, —4y,1 +1 is) 


IX Number Solution of Partial Differential Equations 


1. Classification of second order equation: 


a” a” a” du du 
A(x, y) — + Bla, y) ' TEE le Xx, Y,U,— col 
Ox axdy ay” Ox ay} 
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is said to be 

(i) elliptic if B?-4AC < 0 

(ii) parabolic if B* — 4AC = 0 
(iit) hyperbolic if B’ — 4AC > 0. 


2. Laplace equation: 


(i) Standard five point formula: 
1 
uj = qlee + Wis; + Uj f+ + tic | 
(ii) Diagonal five point formula: 
1 
ui, = glue F jy) ja T Uist ja + diag 


(Four conditions are required to solve Laplace equation.) 


. : au ou 
3. Poisson’s equation: —z +z = f(xy) 
ox” dy 
Standard five point formula: 


Ui j + Uist y + Ui jo 


i + Uy — 40, = h7flih, jh) 


4. One-dimensional Heat equation: 


(i) Schmidt formula: u, ;,., = uj), + (1 — 2a) uy, + @Uj.1, j 
where a@ = kc’/h* 


(ii) Bendre-Schmidt relation: u, j4, = Au, tian 
[when @ = 1/2 (7) reduces to (i7)| 
(iii) Crank-Nicolson formula: 
AU 1 + Ui-1,; +1) —2(@ + 1) uy pn = 2(@— 1) u,  — Aj, + U,)) 


ou 
5. Wave equation: a aaa 


(i) Explicit formula for solution is 
U; 1 = 201 — 7c’) u, , + 7C? (Uz, ; + Wins, ) — Ui 1 Where a = k/h 
(ii) If @ is so choosen that coefficient of u;, 7 is zero, then 
a(= k/h) = 1/c i.e. k= h/c, then (i) takes the simplified form 


Uj ju = Uia,y + Ua — Ui 


which provides as explicit scheme for the solution of the wave equation. 


APPENDIX 


ANSWERS TO EXERCISES 


Exercises 1.1 
1. 3.264, 35.45, 4986000, 0.7004, 0.0003222, 18.26. 


2. 0.7546; — 0.0002 x 105; 0.00265. 3. 0.0003, 0.001. 
A, 0.077. 5. — 0.0004 6. 4.44%. 
7. 0.01%; 10% 8. 1.65. 9. 1.149 x 107+; 4.836 x 10+. 
10. 600.0002. 11. 165.55. 12. 0.17312; 0.0003178. 
13. 0.5. 14. 0.0005. 
Exercises 1.2 
1. 0.0025. 2. 76. 3. 75.6; 0.7. 5. 0.23; 0.14. 
6. 0.7721. 7. 0.423 8. 10. 


9. log, (1.2) = 0.1823215; n = 9. 
h® h> 
10. ¢” +cos(h)=2+h+ ait O(h*); e cos(h)=1+h— = O(h*). 


2p p 2 2 
11. sin(t)+ cos(t)=1+t—-—-—+—+ + o(¢*) 
2 6 24 120 


2 2. 
sin(t)cos(t) =t — ae 4— op +00"). 


15 
Exercises 1.3 
1. (b) 2. 0.000005. 3. (Db). 4. 0.00049. 
5. 0.007. 6. 43.38; 0.63264; 0.2538. 7. 0.004. 8. 0.0058 
9. (c). 10. 0.0015. 11. 0.0496. 12. 0.33. 


13. 0.0005. 14. < 1 (p x 10""). 
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Exercises 2.1 


1. xt — 6x? + 3x? + 42x — 70 = 0, 2. (i) -—2,14 3%. (ii) 2+/3, 3,-5. 
4.a=2,b=1, 51,2 4V5. 6-726 Liag 
9. 4/3. 


Exercises 2.2 


1.x? + 6x? — 36x + 27 = 0. 2.07 4+ 3x9 48 4:27 4+ Tx -1 = 0. 

3. 1Ox* + 9x? + 8x? -— 7x + 1 = 0. 4, 2/9, 2/3, — 2/3. 

5.42, 2,-3,-1; @2,2,1, 1. 6x44 1329 + 60x? + 116x + 80 = 0. 
2 3 2 2 


. (5+ V51):5 5 (385) 8. y?— 30y? + 225y — 68 = 0. 


9. . — 11x? + 9x - 2 = 0. 
10. Quotient = 15x° — x4 + 143 + 12x? — 7x — 21, Remainder = — 9x + 29. 


Exercises 2.3 


1. 1.32. 2. 0.45. 3.0.71 rad. 4. 1.81 rad. 
Exercises 2.4 
1. (i) 1.321 ii) 1.46 iii) 2.875 (iw) 1.855. 
2. (i) 0.0625. ii) 0.567. iti) 0.367. 
3. (i) 2.128. it) 2.7065. iii) 1.4036. 
A, (i) 0.853. ii) 0.6071. iii) —0.134 — (iw) 2.798. 
(v) 3.789. vi) 0.3604. 
5. (i) 1.861. 6. (i) 0.99976. ii) 0.99931. 
7. (i) — 2.0625 ii) 0.567 iti) 3.496. 
8. (i) 0.6071. ii) 2.9428, iii) 1.4973. (iw) 4.4346. 
(v) 0.2591. vi) 2.8625. 
9. (i) and (ii) 5.4772. 10. (i) & (ii) 1.524. 11. 0.477. 
Exercises 2.5 
1. (i) 1.532. (ii) 2.095. (iii) 1.834. (iv) 1.226. 
i) 1.856. (ii) 2.198. 3. — 16.56. 
4, (i) — 1.9338. (ii) 2.798. (iii) 4.545. (iv) 0.052. 


(v) 0.518. (vi) 0.695. 
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5. Root in interval (— 0.8, 0.5) = 0.77009, Root in interval (0, 1) = 0.76839. 


6. 6.889. 7. 0.5886. 8. 0.033 sec. 
9. Xn+ = a SE se me = 3 (2x, +N/x2);(a) 3.162. (b) 2.5713 
1 N 

10. X,4, = ri 3x), +] , 2.3784 
11. (i) 0.0555. (ii) 0.2582. (iii) 0.4347. 12. 0.51776. 
Exercises 2.6 
1. 2.26 2. 1.839 3. 1.3688 4, 3.14. 
Exercises 2.7 

1. (i) 1.532 (ii) 0.684 (iii) 1.168. 2. 1.674. 

3. 2.231. 4, — 1.328. 5. 2.924. 


Exercises 2.8 
1. 2. 2.m = 2, 3.973. 3. — 0.573 + 0.89% 
4. x? + 2.9026x — 4.9176. 5. — 0.759, — 1.42, — 3.411 + 2.903i. 
6. (x? — Qn + 2)(x?- 6x + 25). 7.5, 2.001, 0.9995. 
8. 3,2, 1. 9. 7.018, — 2.974, 0.958. 10. 2, 1,1. 
11. 6.3, 2.3, 0.4. 


Exercises 2.9 


1 < 
1. (a). 2. Xntl =5(2e, +N/x2) : 
1 an 
3. Xn41 = =(2x, +21). 4, Xo =X 2 (x ) 
5. (c), 6. Chord AB. 7. nai = tn HN ty) 
8. 1.79. 
9. Initial approximation is chosen sufficiently close to the root. 10. (c) 
11. Newton-Raphson method. 12. 0.657. 
13. (c). 14. | ¢’(x) | <1. 


15. If we start with a smaller interval for the root. 


16. True 17. 2.1. 18. (2,3) 


19. x, (2 — Nx,,) 20. If we start with a smaller interval for the root. 
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Exercises 3.1 


5.0, 2. 6.5. 
2 


Exercises 3.2 


lx=2,y=4,2=lwe=s. 4/3 1 3 441-2 0 -2 


-3 #1 7 -3/4 1/4 7/4 7 -3 -38 
4./-1 -1 -5])-14 -14 5/44] 5./-1 1 O 
5 1 -18]) 54 4 —-13/4 -l 0 1 


1 0 O;|5 —-2 1 
6.|75 1 O};0 195 325 7. (i) 2: (i) 3. 
V5 4119 1]/}0 O 3827/9 
8. (i) Inconsistent (ii) Inconsistent (iii) Consistent, x =— 1, y = 1,2 = 2. 
9.(i)A=3,p410; (iA; (iii) A = 3, p = 10. 
10./ = 1,-9. Ford = 1, sol. isx =k, y =—k, x = Qk. 
Ford = —9, sol. is x = 3k, y = 9k, x = — 2k. 


Exercises 3.3 


l.x=2,y=-1,2=1/2. 222 12,y=2.2,2=3.2, .2£=ysese. 
4.u=1,0=1/2,w = 1/3. 5. x = 19/50, y = — 29/50, z = — 51/50, t = 0. 
6.x =2,y=1,2=0. Les ly =—5,2 =5, 

S.2=y =2z = 2. 9. i, = 1.5, i, = 2.5. 

10. i, = 1.5; i; = 2.5. Hes] = 9.4 =, 

12. x = — 12.75, y = 14.375, z = 8.75 13.x =1y=2,2=3. 

14. x, = 2,%5 =—1,x3 = 3. 15.2; = 1, %9 = 2,x%3,=-1,%,==2. 
16.22 1,723,220, M22 89,9 20.1,62=135. 

IS. ¢= ly = 3,2 =5. WW.x=ly=2,2=3. 

20. x, = 2, x5 = 1/5, x, = 0, x4 = 4/5. 21. x = 35/18, y = 29/18, z = 5/18. 
22.x=y=2e=1. 23.0 = Lay=5,2= 5, 


24.%, =—1,%. = 0,43 = 1x4 = 2. 


APPENDIX B: ANSWERS TO Exercises ° 907 


Exercises 3.4 


1. x = 2.556, y = 1.722, z = — 1.055. 2x=ly=2,2=3,u=4. 
3.x = 2.426, y = 3.573, z = 1.926. 4.x=l,y=1,2= 
5. x = 0,998, y = 1.723, x = 2.024. 6.x =y=z= 
7.x, = 1.058, x, = 1.367, x, = 1.962. 8.x, = 3, x5 =— 2.5, x5 = 7. 
9. x = 1.35, y = 2.103, z = 2.845. 10.*x =y=z= 
LL. x = 52.5, y = 44.5, 2 = 59.7. 12. x = 1.93, y = 2.57, 2 = 2.43. 
Exercises 3.5 
1. Il-conditioned. 2.x=2,y=-1,z=1. 
Exercises 3.6 
lx =2,y =1;x =— 1.683, y = 2.164. 2.x = — 1.853, y = — 1.927. 
3.x =3,y =4. 4.x = 0.7974, y = 0.4006. 5.x = 3.162, y = 6.45. 
Exercises 3.7 
1. (b) 2. Section 3.5 
3. Diagonal 


4. The absolute value of the largest coefficient is greater than the sum of the 
absolute values of all the remaining coefficients. 


5. diagonal matrix. 6. (b) 7. Upper triangular matrix. 
8. False. In fact, the rate of convergence of Gauss-Seidal method is twice as fast 
as that of Gauss-Jacobi method. 


9. Section 3.4(3). 10. (a) lie Ly =I. 
Exercises 4.1 
8 -l -3 V7 -12 172 ; 1 10 —-7 
lj|-5 1 2 2./-12 3 -1 3. a 1 -ll 14 
10 -l -4 5/2 =—3/2 1/2 -3 12 0 
; 2 -2 | -05 02 -16 V/s -1/f8 3/8 
4. A -2 5 -4 3} 0) 0600.2) «(0A 6./-1/8 18 5/8 
1 -4 5 05 O 1 8 5/8 23/8 
i 206 -17 —24 14 02 -04 
7. -16 102 22 8. | — 
2078 15 0 0.5 
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-15 -14 12 18 
9, 1 3 7 -6 -2 10. 0.091 0.182 
9| 9 -3 0 -3 0.273 —0.454 


0.429 2429 —1.429 
1l.| 0.143 0.143 -0.143 
—0.857 —3.857 2.857 


Exercises 4.2 

1. (a) 1, 6; (1, — 1), (4, 1) (b) —1, 6; (1, 1), (2, —5). 
2. (a) 1, 2, 3; (1, 0, — 1), (0, 1, 0), (1, 0, 1) 

(b) 5, —3, — 3: (1, 2, — 1), (2, — 1, 0), (3, 0, 1) 

(c) 8, 2, 2; (2, — 1, 1), (1, 0, — 2), (1, 2, 0). 


1 Ww -2/3 [2 ta fs ou -t 
3()}0 -12 0 | Go 38 Of Wy Zf1 3 1 
0 0 WB ai. <i. 2 -11 3 
0.46 
4, 0<A<5T7 5. (a) 5.38 4.618 
) | 1 } 0) ial 
6. (a) 11.66, [0.025, 0.422, 1)’: (b) 7; [2.099/7, 0.467/7, 1 


(c) 25.182, [1, 0.045, 0.068). 
Exercises 4.3 ; ; 
1. (a) 4, -2, 6; [1/V2,0,-1/V2] , [0, 1, oy, [VV2,0,1V/2 ] , 
(b) 0.3856, — 1.3126, 5.9269: [0.5654, — 0.2949, — 0.8243)’, 
[0.5457, — 0.736, 0.4006)’, [- 0.6185, — 0.6763, — 0.4001)’. 


ff 211 - @ 1 2/2 0 1 
2./-112 14 -055} 3.0,3,3.4./2V2 3 O};5/1] 5.3.13. 
0 -055 16 oe © <1] I 
Exercises 4.4 a l 
1. Zero or unity. 2. : 3 4, 1,1, 1/5. 
i A 
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5.5, -2. 6. A“ 7.2. 8. largest. 
9.1 + V2. 10. eigenvalue. 11. 5.38. 
08 —-0.4 —-0.2 
12. either zero or unity. 13. — 4 14.}-02 06 -—02 
1 7 -02 -04 0.8 
15. the largest 16. 7x =A xX. 
Exercises 5.1 


1. a = 2.28, b = 6.19, p = 30.46. 
2. (i) Y=a+bX,whereX=x,Y=y/x. (ii) Y=a+ bX where X = Iky , Y =x 
3.a = 1120,b=55.1. 4.a=0.2,b = 0.0044. 5. n = 1.3, c = 200. 


6.4 = 0.5012,n=0.5. T.a=4.1,b = 0.48. 8. a = 0.05, b = — 0.02. 
Exercises 5.2 

= 156K, 2. v = 1.758 — 0.05380. 

3. Y = 0.004 P + 0.048. 4. R = 70.052 + 0.29t. 5. y= 48.9 + 0.5067x. 


6. y = 1.243 — 0.004x + 0.22x7. 7. y = — 0.703 — 0.858x + 0.992 x”, 
8. y = — 0.98x" + 3.55x — 27x. 9. V = 2.593 — 0.326 T + 0.0237". 
10. R = 3.48 — 0.002 V + 0.003V?. 


Exercises 5.3 

1. a = 6.32, b = 0.0095. 2.a = 1.52,b = 0.49. 

5.0=3,6<9. 4. y = 7.187 —5.16/x; 4.894. 

5. a = 0.5012, b = 1.9977. 6. y = 2.978x"""*, 5.8769 

7k =7.17,m = 1.95. 8. a = 9.484, b = 0.315 

9.9 =0.1839e""". 10. a = 32.15, b = 1.43, N = 387. 
11. a = 146.3, k = 0.412. 12. fit) = 0.678e~" + 0.3126 
13. x = 0.999, y = 2.004. 14. x = 1.17, y =-0.75, z = 2.08. 


Exercises 5.4 
l.a=11.1,b =0.71. 
3. y = 46.05 + 6.1 x. 


a =2.1,b = 0.19, p = 306. 

.a = 6.73, b = 0.0092. 

5.c = 2.6,n = 2.5. .a = 0.0028, b = 0.01, c = 4.18. 
Tac IG8 ba D1, ba 0 5. a = 1.459, b = 0.062 

0e= BA beO7 Th=-04s 10.02 10,5531,.n 5-01, 


on - WY 
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Exercises 5.5 
1. y = 0.12 + 0.47. 2.y = 1.184 + 0.523 x 


3. y = 1.53 + 0.063x + 0.074x?. 4. y = 0.485 + 0.397x + 0.124x”. 


Exercises 5.6 


1. zero. 2.y =aX+c,whereX=x’. 3. (ii) 

4. Xy =nA + BxXx, Xxy = AXx + BXx? where y = log, y, A = log, a, B = logy, b. 

5. Section 5.9. 6. Section 5.6. 7. Y = aX + bwhere X = x"/log,) x, Y = 
y/logyy x. 


8. a = 0.0167, b = 1.05. 


9. The moments of the observed values of y are respectively equal to the mo- 
ments of the calculated values of y. 


10. a = 1.7, b = 1.26. 
1 1 
ll.y=a+bx where x =logyp,y = logy v, a=—logk,a=—— 
k Y 


12. Y =a + bX, where X = 1/x, Y = 1l/y. 
13. (C) 14. (C) 15. (B). 16. (A). 
Exercises 6.1 
2. 0.4. 3. — 7459. 5. 241. 6. 239. 
7. 4.68, 2.68; 55.8, 99.88. 
= 1 
9. (i) 1-2 sin (x + 1/2) sin 1/2, (ii) tan : [=] (iii) e* {e° log (1 + I/x) + (e?- 1) 
Qn 
log 2x} (iv) 2* (1 —x)(1 + x) (v) 192/[x(x + 4) (x + 8) (x + 12) (x + 16)] 
(vi) — 2/[(x + 2)(x + 3)(x + 4)]. 


10. (i) (e? — 1)" e**; (i) (— 1)" nV/[x(x + 1)(x + 2)--- (x + n)] 


n + 
(iii) (2 sin] sna +b ee) (iv) (e" — 1)" e*8 
(vo) (— 1)" nl {x(x + 1)(x + 2)... (x + n)}. 
14. (i) 576; (ii) 24 x 210 x 10!. 
Exercises 6.2 
1. [x]? + [xP -1. 2. y = 3[x]}* + 14[x} + 15[x]? + 7[x] + 1, A’y = 72. 
3. 4x3 — 12x? + 8x + 1; 12x(x - 1). 


APPENDIX B: ANSWERS TO Exercises ° 911 


1 , 
4. (i) {x} +3[xP +4[x] +0. i) =(120° —105x* +170x3 + 15x? + 148) 
6. 80640(2x + 9)(Qx + 11)... (2x + 19). 


7. 192{(4x + 1)(4x +5)... (4x + 17) al(4r+ 1)(4x+5)}" 


8. 2.0086. 9. 15. 10. x? + 2x? + 3x. 


Exercises 6.3 


2. (i) 2(cos h — 1) sin x; (ii) 8. 

(iii) 6h7(x +h); (iv) 2(cos h — 1)[sin (x + h) + 1). 
10. 31. LL. fUL.5) = 0.222, f(5) = 22.022 
12. y(4) = 74, y(6) = 261. 13. (2004) = 306, y(2006) = 390. 
14. — 99. 15. y, = 1 approx. 


Exercises 6.4 


1. n(3n? + 6n + 1). 2. n(n + Din + 2)(n +3) 3. ! fr- 2 
n , 4 (n+1)(n+2) 


4, ee. 1 5. n(n + 1)(2n +1) 
214.5 («+4)(x +5) 6 


6. (i) e*(1 + 7x + 6x? + x3); (di) e* (1+3x 43° +423). 
7. Gi) (3 + 6x — x9). — 2) @) (1 +2). -2). 8. 59 6" +15n® +10n? — 1). 
9 


Exercises 6.5 


1. (a). 2. (b). 3. 18. 4, E =e", 
5. zero. 6. 3x(x — 1) 7 [xP +[xP-1. 8. 6h2(x +h). 
9.1-E". 10. a polynomial of the 6th degree. 11. zero. 
12. 4x° — 3x? — 5x. 13. 1, 3, 7. 14, — 90 
15. tana (—*_}. 16. 2. 
l+hx +x? 
17.A=E-1. 18. Constant. 19. V" yx. 20. e* A? e*. 
21. V2? =(1— EF"). 22. (e—1)" et. 23. A = EV. 24.5. 
25. V — V?. 26. (x — 2)°. 27. 16.5. 28. (d). 29. (c). 


30. (c). 31. (d). 32. True 33. False. 
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34. False. 35. True. 36. True. 37. True. 


Exercises 7.1 


1.5.54. 2. 6.36; 11.02 

3.6 = 0.01 x7 + 1.01x + 130.1; O(x = 43) = 192.02. 4. 0.788. 

5. 4.43. 6. 8666. 7. 0.9623, 0.2903. 

8. (i) L, = 0.5878 (ii) f, = 0.363. 9. 352. 10. 24. 
11. 14706 approx. 12. 1.625. 13. 33. 14. 0.1955. 
15. y= 2 8° + _ x = 56x +31. 16. 2530. 17.0.1; 100. 
18. 369 oe tons. 19. uy = 42, us = 49. 20. 10, 22. 21. 755. 
Exercises 7.2 a0 

1. 32.95. 2. F(x) == 4 _ 8x8 t= —56x +31. 3. 19.4. 

A, 3.2219 5. 54000. 6.0.70711. 7. 395. 

8. 3.0375 9. 0.934. 10. 9. 11. 32.945. 
12. 3.347. 13. 14.368 14. 3250.875. 
15. 2.5283 by all formulae. 
Exercises 7.3 

1. 14.63 2. 7.03. 3. 2.8168. A, 0.89. 

5. 100. 6. 648 + 30x —x?. 7.23 — 3x? + 5x — 6. 

8.x° — 9x4 + 18x3 — x7 + Ox — 18. 9. 3. 


0.5 _ 0.5 = 1 
10. x-l xtl x-2 qYX 


i383 1 Bi ad 
“5x-1 35x+1 10x-4 70x-6 


Exercises 7.4 


Pol 2. 133.19. 3. 100. 4. 1.48 mV. 
_ 13 79, 557. 
5. f (x) =—(x? — 25x + 24), 6. fH)= 55% —% + 60 x= 25. 
1 
7. f(x) = xt — 3x? + Sx? - 6. 8. 147 9. y= alr —x° +4x—6), 


10. 31. 


APPENDIX B: ANSWERS TO Exercises ° 913 


Exercises 7.5 l 


1. P(x) = x4 42741. 2. P(x) = 75 6-a)e. 3. 1.1631. 


Exercises 7.6 
3x°-Q9x7 +1lx-1l, Isxs2 


, y(1.5) = —4.625; y'(2) = 11. 
—3x? + 27x? —61x +37, 25x53 4 4 


1. y(x) = 
3. y(x) =4[-142.9x° + 1058.4" — 2475.2x + 1950 | 
(i) y(2.5) = -24.08, (ii) y’(3) = 2.817. 


Exercises 7.7 
1.11.5 2. 6.304 3. 37.23. 4, 2.3. 


5. 0.2679 6. 1.3714. 


Exercises 7.8 


1. Section 7.3. 2. (b) 
3. x fix) LD.D. ILD.D. 
D 7 
2.9 
15 36 0.87 
17.7 
22, 160 
4, Intermediate value of the variable. 5. Section 7.8. 
6. [sistasete. ty |=[ 25, m1 tess | 7: vl er | om 


8. Section 7.14 


9. f(x)= 
(a4 7X (x — xy) (x, xy (x, as) (x, — Xo (x5 i) 
10.72. 
5 
11. Lagrange’s interpolating polynomial P(x) agrees with y(x) at the points x, 
X1,....,<, Whereas Hermite’s interpolating polynomial P(x) and y(x) as well as 


P(x) and y’ (x) agree at the said (n + 1) points. 
12. 1.857 
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13. Extrapolation is the 


given range of values. 


16. 1° — 7x? + 18x — 12. 


Exercises 8.1 

1. — 27.9, 117.67. 
4. (a) 0.493, — 1.165 
5. 2.8326. 

8. (a) 0.3907: 

9. 7.956 

10. (i) — 52.4, 
12.3. 

15. 0.2561. 

19. 135. 

21. 0.692, 0.6137. 


Exercises 8.2 
1. 0.26. 


(iit) 0.693. 
(iii) 0.78535. 
4. 1.61. 
7. 0.635. 
9. (i) 1.1249 (ii) 0.9744 


process of estimating the value of a function outside the 


14. 1/(abc). 15. (a). 
17. (b). 18. (c). 
2. 4.75, 9. 3. 0.63, 6.6. 
(b) 0.4473, — 0.1583; (c) 0.4662, — 0.2043. 
6. 1.4913. 7. — 0.06; 0.5. 
(b) 0.9848; (c) 0.342. 
(i) — 0.0191. 11. 44.92. 
13. 3.82 rad./sec., 6.75 rad./sec.”. 14. 0.5403. 
17. 0.1086. 18. y’(4) = 2.883. 
20. mal) = 0.25, Yin(O) = 0. 
22. Max f(10.04) = 1340.03. 
2. (i) 0.695 (ii) 0.693 
3. (i) 0.7854, (ii) 0.7854, 
(iv) 0.7854. 
5. 53.87, 53.6. 6. 70.16. 
8. (i) 2.0009 (ii) 1.1873. 


(iti) 0.0911 (iv) 14.51086. 


10. (a) 1.8276551,.0001924: 


(c) 1.8278470,.0000005; 


11. 1.3028. 
15. 3.032. 


18. 1.063 sec; 1.064 sec. 


21. 29 min. nearly. 


Exercises 8.3 
lLn=8 
4. 1.000003. 


h h 
i ydx = 5 (vo oe i= 


12. 403.67. 
16. 3.032. 


19. 552 m.; 3 m./sec.?. 


2. 0.3927-; a = 3.1416 
_ 01138; 


(y 7 yi): 


(b) 1.8278472,.0000003; 
(d) 1.8278474,.0000001. 
13. 7.78. 14. 710 sq. ft. 
17. 408.8 cub. cm. 

20. 30.87 m/sec. 


3. 1.8278 
(b) 0.00083. 


8. (i) 4.685 (ii) 1.00002 
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9. (i) 1.6027 (ii) 0.2376. 10. (i) 200.4014 (ii) 0.2666. 11. 0.4999. 


Exercises 8.4 


1. 0.876. 2. (i) 3.076 (ii) 0.31913. 
3. 25.375. 4. 4.134. 
5. (i) 0.49. (ii) 0.3844. 
Exercises 8.5 
1 145 1 43 
1. (c) 2. —| Af(a)-—A* f(a) +~A’ fla)... 
h 2 3 
3.h should be small. 4. 0.775. 5. 2 6. Section 8.4 (III). 


7. (b) Section 8.4 (I). 8. larger number of sub-intervals. 9. 0.7854. 


10. 
11. 


12. 


14. 


17. 


19. 


21. 
23. 
25. 


Section 8.4 (II). 
hk 
1=—[(foo + foo) + 2fo + (fio + fia + 2fur) + (fan + fos + 2fa1)]; 
Sir flxdx = f(-V3) + f(V/V3). 1 
27 72 
a multiple of 6. 15. (b). 16, r= BE 
h? r r h* m m 
(c). 18. aa =H) Fa —yl")+ 
8 5 3 3 
0)+ — Jo l+ fi Jol. . second ¢ 
9 f (0) 4 & in| 20. second and fourth 
0.783 (b - a) 22. where nh =b-—a. 
0.69. 24, 1.36. 
If the entire curve is itself a parabola. 26. False. 


Exercises 9.1 


1. Yui3 — 2Yx49 + 24.41 = 9. 2. Ay, =(-I)"Vn+1). 3.1 


—2u, =0 


bined 


4. (i) (x + Qyy 9 — A(x + Lyy.s + xy, = 0; 


(i 
5. ( 


i) (x? + x)Yeig — (2x? + Ardy. + (x? + 3x + Q)y, = 0. 
i) Yns2 — 8Yn 44 + 15y, = -_ 0; (ii) t Ynsa — 6Yn41 + 4y,, = 0. 


6. (i) (x — (3x — 2)y..1 + 2xy, = 0; 
(ii) Yx.9 - x= 0; (iii) Yx33 = 6Y,..9 + Wye a 6y, = 0. 
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Exercises 9.2 


Qn _ Qn 
leu, =(1—n)". 2. Y, =Cy OO sin 7 
3.u,, = C, cos nz/2 + cy sin n7/2. 4. y,, = C). 2" + Cy. 3", 
5. y, = (2)h 1 + (- 2). 6. u, = c)(— 1) + (e5 + egk)2*. 
7. f(x) = (ec, + exx)(— 1 + c5. 2%. 8.u,, = 2n + (— 2)". 
9.y, = 6 + (n—3)2”, 10. w,, = 2" {c, cos nz/4 + cy sin nz/4}. 
1l. 2" fy ae +c rs +c ee +c sin | 
Ym = 4 2 4 3 4 4 4 
15. y,, = ¢,(— 1)" + c,(10)". 
Exercises 9.3 
l 1 6)" —2"/12 2 (= : I 3) $2 
i = a n ; mn 9n/y 9. .y =|—-—|(- paar 
Yn Cy( ) BE Col ) Yn 15 95 95 


3. Yp =O teop tesp’ + Ep(p—Vip—2). 4, y= oe, +09 °3° thx-3°", 


5. Uy, = C). 2° + Cy. & —6. 4. 6. y, = (C, + Cox) 2* + Sax — 1/27 4 5. 41. 


T. Uy = Cy +¢9(-1)" +- 


1 
cos — 
8. y, =C tase + C5 gp? Poe a) 
2 2 2sins 


4 nJt nt 
Yn = 2" —2cos—|+2. 
9. Yy, [sin 3 COS =) 


_ 
—) 
< 
| 
io) 
s 
+ 
bo 
+ 
S 
bo 
bo 


_9) == (9x? +12x+11). 


nt nt 1 
U1. Yn, =C(-1)" +e, cos“ +3 sin + 5nln—3), 


_ gn n-1 
13. y, =(c +cyn)2 ‘ +2 +nin=1(5] . 


14.4, Hoe) FQ 3) 
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3. te D4 oo. 
— + c5x)(—3)* +—(5x -2 yt? : 
15. U, (c, Cox) ) oe x \+ ra + id 


3 = 
16. Yn =C,(—2)" +2" (c, cos nzt/3 +c sin nat/3) + Tal +2"-4(9n +3). 
1 2 n 
17. u, = 4c, +e,n+—n(n—-1)"(n— 2) 12”, 
48 
18. y =c,:2' +c,°35 +—(k —13k +61). 
19. y, =2" G + n)cos™ + C5 sin =} 


3 
Exercises 9.4 


1. y,,1 = @Yy,, Sol. is y, = ca’. 2. y, = 261, 
1 x 
3. Yx = «(5 or y, = c(— 1). 4.y,= 62)" 
tes joe _ ce tog (x +12" 


dD. Yx 6. Yx 


c, +0,/2" ° 6: Feine” 


Exercises 9.5 
ly, =a+b(-1)' +x, 2, =a + b(-1)*'- (x + 1). 
2. y, = (a+ bx)(-1)" — =. 9, By === (-1) [a+b(x-4)]. 
3. u, =2°4"-2-4n(n-1), v, =4"° +24 5n(n+1). 
4, u, =—2a+ b(-2)* —c+$x(3—2), v, =ate+b(-2)", 
w, =atb(-2) +$x(x_]). 


Exercises 9.6 


1. Yin — 24, + Yi = — Hy, . Solve it for y;. 

Exercises 9.7 

1. y,.2-5Y,.1 + 6y, = 0. 2u,=c,+ent+e;n.  3.u, =C, + Cy (—2)" + €3(3)". 
4.y, = 1+ 2", 5. y, = c(2)"—(n + 1). 

6. (x? + x)Yyy y 9 — (2x? + Ax)y, 1) + (0? + Bx + Q)y, = 0. Tey, = c(2)k + 1. 

8. y, = (2)""'+(-2)""". 9. Third. 
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10. (x + 2)yn.2-2(n + 1) y,,, + ny, = 0 
1 7 
11. Second. 12. (C, + Cyn) 2", 13. 9 He sy “ 


14. y,.9 — 6y,4, + 9y, =9 15. True. 


Exercises 10.1 


eal eye ie 2. 0.0214 3 ee 
Rn ee eee . 0.0214. ~Ysrx - an t+... 
J 2° 8 48 I~ 3* 8] 


A, (a) and (b) 0.9138. 

5. y(1.1) = 0.1103, y(0.2) = 0.2428, Exact values y(1.1) = 0.1103, y(1.2) = 0.2428. 
6. 2.02061. 7. 1.1053425. 8. 1.1164; 1.2725. 

9. 1.00035. 10. 1.005. 


Exercises 10.2 


1. 1.1831808. 2. 0.4748. 3. 1.1448. 
4. y(0.1) = 0.095, y(0.2) = 0.181, y(0.3) = 0.259. 5. 2.2352 
6. y(0.2) = 1.2046, (0.4) = 1.4644 7. 1.0928. 8. 5.051. 
Exercises 10.3 
1. 1.7278. 2. 2.5005. 3. 1.0207, 1.038. 
A, 2.5005 5. y(0.2) = 2.44, y(0.4) = 2.99, y(0.6) = 3.68. 
6. (0.1) = 0.9052, (0.2) = 0.8213. 7. y(0.1) = 2.9917, (0.2) = 2.9627. 
8. 1.1678. 9. 1.1749. 10. y(0.5) = 3.219, y(1) = 3. 
11. 0.3487. 12. 1.0911, 1.1677, 1.2352, 1.2902, 1.338 


Exercises 10.4 


1. 3.795. 2. 1.2797 3. 1.5 approx. 
4. y(1.4) = 3.0794, 5. 1.837 6. y(0.4) = 2.162 
7. 0.441. 


Exercises 10.5 
1. 0.2416. 2. 1.0408 3. 0.6897. 


4. y(4.4) = 1.019. 5. 2.5751. 6. y(1.4) = 0.949. 
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Exercises 10.6 


a oe er ee 
1.95 SL ae 
2 40 40 192 
1 3 1 3 7 1 
% =—+ xt +—x? +— a + xo + xl? 
2 8 10 34 340 256 


2. x(0.4) = 0.5024, y(0.4) = 0.6012. 
3. y(0.1) = 0.105, y(0.2) = 0.22, 2(0.1) = 0.999, z(0.2) = 0.997. 
4, (0.1) = 2.084, z(0.1) = 0.587. 


1 oz 
5. Ys Tete ag: 6. 0.5075. 7. 1.1404. 


8. (0.2) = 0.9802, y’(0.2) =-0.196 9. — 0.5159. 
10. 6(0.2) = 0.8367, (dO/dt), 5 = 3.6545. 
11. v(0.02) = 0.9965 vo, (dv/dt)y 92 = — 0.3292 vo. 


2 
2 


Exercises 10.7 
5. (a)0<h< 0.2; (b)0 <h < 0.278. 


Exercises 10.8 
. 0.14031. 2. (25) = y(.75) = 2.4, y(.5) = 3.2. 


1 
3. y(1.25) = 1.3513, y(1.5) = 1.635, (1.75) = 1.8505. 

4. y(.25) = — 0.3473, y(.5) = — 0.9508, y(.75) = — 1.7257. 

5. n = 2, y(0.5) = 0.1389, true value = 0.1505; n = 4, y(0.5) = 0.147. 

6. y(.25) = 0.062, y(.5) = 0.25, y(.75) = 0.562. 7. y(1) = 1.0171, y(2) = 1.094. 
8. y(1) = 7.4615. 9. 0.189, 0.642, 1.217, 1.740. 

10. Taking my = 0.8, m, = 0.9, we get m, = 0.9998 and y(1) = 1.174. 

11. Taking mp = — 1.8, m, = — 1.9, we get mz = — 2 and y(0.5) = 0.4441. 


Exercises 10.9 
1. (b). 2. yi. — 2y;, + yi + h?y; = Sh. 
3.lixta? 4+ x°/6. 4. Section 10.4. 5. Section 10.3. 


6. That it can be applied to those equations only in which succesive integrations 
can be performed easily. 


7. Ys = Yo Pas +4f;+ fy). 
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1. 
3. 
4, 


Ex 
1. 


2. 


3. 
5. 
6. 


8. 
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h 
. Modified Euler’s method. 9. yy = Yo + 3 fo —59f_,+37f.,-9f-3). 
. It does not require prior calculations of higher derivatives, as the Taylor's 
method does. 7 ‘ 
. four. 12. y=1+ = ae . 13. Runge’s method 
4h 
- Ys = Yo sora) — fo +2fz) 
h 
: n= Yo t 57 (Of +19f — 51 + Fe) 16. 1.1818 
. dy/dx = 2, dz/dx + y(1 + yz) = 0 18. Section 10.7(iv). 
. starting values. 20. Picard’s and Runge-Kutta methods. 
. It agrees with Taylor’s series solution upto the terms in h4. 
ed. 23. Section 10.17 (3) and (4) 
. (a). 25. Section 10.1 (3). 26. (c). 
Yin + 2(h?-l)y,+y,-1=0. 28. (b). 
. Milne’s method & Adam-Bashforth method. 30. (b). 
. True. 32. False. 33. False. 
ercises 11.1 
Parabolic 2. Hyperbolic. 
(i) Parabolic. (ii) Elliptic. (iii) Elliptic. 
Outside the ellipse (x/0.5)? + (y/0.25) = 1. 


ercises 11.2 

u, = 7.9, us = 13.7, us = 17.9, u, = 6.6, us = 11.9, ug = 16.3, uz = 6.6, uy = 11.2, 
Ug = 14.3. 

u, = 2.38, Us = 5.6, us = 9.87, uy = 2.89, us = 6.14, ug = 9.89, wu, = 3.02, uy = 6.17, 
Uy = 9.51. 

u, = 26.66, us = 33.33, us = 43.33, u, = 46.66. 4. u, = 0.99, uy = 1.49, uw, = 0.49. 
u, = 1.999, us, = 2.999, uw; = 3.999, uw, = 2.999. 


(a) u, = 0.126, us, = 0.126, uw; = 0.376, uw, = 0.376. 
(b) u, = 0.126, wu, = 0.126, uz = 0.376, uy = 0.376. 


.U, = 1.57, us = 3.71, us = 6.57, uy = 2.06, us = 4.69, ug = 8.06, u, = 2, uy = 4.92, 


Ug = 9. 


u,=—3,U,=-2,u,=-2. 9.u, =u,=—4.5, Uy = — 6.25, us = — 2.75. 
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Exercises 11.3 

Lou, = 1.9, uy = 4.9, wz = 9.1; uy = 2.1, us = 4.7, ug = 8.4; u, = 1.6, uy = 3.9, 
Ug = 6.7. 

2. u, = 275, uy = 350, us = 275; uy = 350, us = 450, ug = 350; wu, = 275, Uy = 350, 
Ug = 275. 

3. u, = 1, us = 1.3, uy = 0.7, uy = I. 


Exercises 11.4 


Op RlwlNBlR|o 


j 
O 0 |0.09 | 0.16 | 0.21 | 0.24 |0.25 | 0.24 | 0.21 | 0.16 | 0.09 0 
1 0 |0.08 | 0.15 | 0.20 | 0.23 | 0.24 | 0.23 | 0.20 | 0.15 | 0.08 0 
i) 0 | 0.075] 0.14 | 0.19 | 0.22 |0.23 |0.22 |0.19 |0.14 | 0.075} 0 
3 0 | 0.07 | 0.13 |0.18 | 0.21 | 0.22 |0.21 |0.18 | 0.13 | 0.07 0) 
me PIPG 1 2 3 4 5 
i 
0 0 24 84 144 144 0 
1 0 42 84 114 144 0 
2 0 42 78 78 72 0 
3 0 39 60 67.5 Di 0 
4 0 30 53.25 49.5 39 0 
Di 0 26.6 39.75 43.5 33.75 0 
6 0 19.88 35.06 32.25 24.75 0 
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6. W111 = Vora = Uia1 = Wea) = 9/16, Uy 12 = Ue12 = W129 = W229 = 27/64. 


Exercises 11.5 
I. 


a0 gene 0.1 0.2 0.3 0.4 0.5 
Num. sol. u = 0.02 0.04 0.06 0.075 0.08 
Exact sol. u = 0.02 | 0.04 | 0.06 | 0.075 | 0.08 
2.) | ee 1 2 3 4 5 
j 
0 0 20 15 10 5 0 
1 0 5 15 10 5 0 
2 0 —5 2.5 10 5 0 
3 0 -5 |-10 ~2.5 5 0 
4 0 -5 |-10  |-15 7.5 0 
5 0 -5 |-10 |-15  |-20 0 
3. 
; Seo 0.1 0.2 0.3 0.4 0.5 
0.1 0 0.037 | 0.07 | 0.096 | 0.113 | 0.119 
0.2 0 0.031 | 0.059 | 0.082 | 0.096 | 0.101 
0.3 0 0.023 | 0.043 | 0.059 | 0.07 | 0.074 
0.4 0 0.012 | 0.023 | 0.031 | 0.037 | 0.039 
0.5 0 0 0 0 0 0 
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A, i 
: 0 1 2 3 4 
J 
0 0 0 0 0 0 
1 0 0 0 0 70.7 
2 0 0 0 70.7 100 
3 0 0 70.7 100 70.7 
4 0 70.7 100 70.7 0 
Exercises 11.6 
1. (b). 2. False. 3. a hyperbolic equation. 
4. Poisson’s equation. 5. uj; = Ui-1j + Wis —Uij-r- 
6. (u;_ 1; — 2u,; + Ui 41M? 7. Section 11.9 (1). 
1 
8. (tenet F Uj41j-1 Fis F u,-1,;-1) 
9. hyperbolic 10. Bendre-Schmidt. 


11. u, 5,1 = 2 (1 — 4a?) wu, + 407(u,_1 5 + Ui41j-Uij-1)- 


12 13. Section 11.5 (2). 


1 
* Ui p41 = g (Mian + ti+1,;) 
1 
14. Section 11.9 (2). 15. 4< 5 16. one dimensional heat 


17. Schmidt method and Crank-Nicolson method 18. Elliptic. 19. O(h)’. 
20. Section 11.6 (2) 


au du 
QL. uj 541 = Wie — Uj — Ur ja 22.—, +, = flay). 
ox” dy 
U4, 7 2U;,,4U4a, Uy jy 7 2U;,, tu; | 
23. 100. 24, i “a oe fs = JG, 


25. y < 0. 26. =— 


27. The solution value at any point on the (j + 1)th level is dependent on the solu- 
tion values at the neighboring points on the same level and on three values on 
the jth level. 


Exercises 12.1 
1. Max. Z = 1.2x, + 1.4x5; subject to 40x, + 25x, < 1000, 
35x, + 28x, < 980, 25x, + 35x, < 875 and x4, x, > 0. 
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2. 


Ex 


ord ® OW GC — 


9. 


10. 
11. 
12. 
13. 
15. 
16. 


Ex 
1. 


Max. Z = 3x, + 2x, + 4x3; subject to 4x, + 3x, + 5x; < 2000, 
Qx, + 2x, + 4x3 < 2500, 100 <x, < 150, 200 <x, and 50 < x3. 


» Max. Z = 3x, + 2x5 + x3; subject to 3x, + 4x, + 3x3 < 42, 


5x1 + 3x3 < 45, 3x, + Gx, + 2x3 < 41 and xj, Xo, x3 > 0. 


. Max Z = 400 x + 300 y; subject tox + y < 200, x = 20, y = 4x, x 20, y 20. 


. Min. Z = x, +X; subject to 2x, + x, = 12, 5x, + 8x, = 74, 


x, + Gx, > 24 and xj, x5, x3 > 0. 


. Min. Z = 41x, + 35x, + 96x3; subject to 2x, + 3x2 + 7x3 = 1250, x, + xy = 250, 


5x, + 3x5 > 900, 6x, + 25x, + x3 > 232.5 and x), Xo, x3 > 0. 


. Min. Z = 100x, + 250x, + 160x5; subject to 0.94%, + x, + 1.04x3 < 0.98, 


10x, + 15x, + 17x; > 14, 470x, + 500x, + 520x; > 495, x, + x9 +. x3 = L and x, x5, 
X32 0. 


» Max. Z = 10,000x, + 9,000x, + 2,800x3; subject to 5,000x, + 4,500x, + 4,250x3 < 


100,000, x, < 6, x, > 2, x3 > 2 and xj, x5, x3 = 0. 


ercises 12.2 

. x, = 20/19, x5 = 45/19; max. Z = 5/19. 2.x, = 8/15, x, = 12/5; max. Z = 24.8. 
2X, = 6, xX = 12; min. Z = 240. A. x, = 500, x, = 600; max. Z = 1200. 
. x, = 50, x5 = 0; max. Z = 200. 

. 450 units of product B only; max. profit = US$1800. 

.X = 2, Y = 4.5; max. profit = US$37. 

.A = 1.18 units, B = 0.53 units; max. profit = US$14.50 approx. 

M = 200 metric tons, N = 300 metric tons; max. profit = US$19,000. 

2000/11 units of product A and 1000/11 units of B; max. profit = US$10,000. 
x, = 4, 2X = 0; max. Z = 8. 

20 to 35 runs in magazine A and 10 to 16 runs in magazine B. 

Unbounded solution. 14. Infinite number of optimal solutions; max. Z = 8. 
xX, = 2,%. = 4; min. Z = 64. 

Production cost will be min. if G and J run for 12 and 4 days respectively. 
ercises 12.3 

Max. Z = 3x, + Sx2 + 8x3; subject to 2x, — 5x, + 5, = 6, 


Bx, + Wo + X3—S_ = 5, Bx] + 4x3 + $3 = 3; %Xy, Xo, X3, $1, So, $3 = 0. 
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2. Min. Z = 3x, + 2x, + Sxy, subject to — 5x, + 2x. + 5, = 5, 


Qn, + Bx, + 4x3 — Sy = 7, 2x, + Sx + Sy = 3, X1, Xo, Vy, Sy, So, Sz = 0. 


3. Max. Z = 3x, — 2x, + 4x4 — 4x5; subject tox, + 2x. + X4—X5 + 5, = 8, 


2x, —Xy +Xy—Xs — Sq = 2, — 4x, + Qy + Bxy— Bus = 6; Xj, Xo, Ly, Ng, Sy, So =O. 

A, (i) x, = 2, x3 = 1 (Basic); x, = 0 (Non-basic) (ii) x, = 5, x3 = — 1 (Basic); x, = 0 
(Non-basic) (iii) x, = 5/3, x3 = 2/3 (Basic); x, = 0 (Non-basic) 
All the three basic solutions are non-degenerate. 

6.x, =x3 =x, = 0 andx, = 1/2. 

7. Basic solutions are (i) x, = 2, x, = 1 (Basic) and x, = 0; (ii) x, = x3 = 1 (Basic) and 
X= 0: (iii) xy = — 1, x3 = 2 (Basic) & x, = 0. 


(a) First two solutions are non-degenerate basic feasible solutions. 


(b) First solution is optimal & Z,,,. = 5. 
Exercises 12.4 
1.x, = 2.x) = 4; max. Z = 14. 2. x, = 0, x5 = 20; max. Z = 200. 
3.x, = 7/3, x. = 4/3; max. Z = 16. A, x, =5,x, =X, = 0; max. Z = 50. 
5.x, =0=%5, X35 = 1; max. Z = 3. 6. x, = 0, x5 = 6, x, = 4; max. Z = 6. 


7.x, = 89/41, x, = 50/41, x, = 62/41; max. Z = US$765/41. 
8.x, = 4, x, = 5, x3 = 0; min. Z =— 11. 
9. x, = 280/18, x2 = 0, x5 = 20/13, x, = 180/13; max. Z = 2280/13. 
10. x, = 0, x, = 400 units; max. profit = US$1200. 
11. x, = 125, x, = 250 units; max. profit = US$2250. 
12. x, = 400 gms, x, = 0; min. cost = US$2. 
13. x, = 0, x, = x3 = 50; max. profit = US$700. 
14, x, = 0.5, x, = x3 = 0.04 units; min. cost = US$5.80. 
15. Acrages for corn, wheat, soybeans are 250, 625, zero respectively to achieve a 


max. profit of US$32,500. 


Exercises 12.5 

1.x, = 0, x5 = 2, x, = 0; max. Z = 4. 2.x, = 3, x, = 2, x3 = 0; max. Z = 8. 
3.x, =— 6/5, x, = — 6/5; max. Z = — 48/5. 

4.x, = 0, x, = 10/3, x; = 4/3; min. Z = 34/3. 
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5.x) =X. =X3 = 5/2, x, = 0; max. Z = 15. 

6. x, = 21/13, x, = 10/13; max. Z = 31/13. 

7. Infeasible. 8.x, = 23/3, x, = 5, x3 = 0; max. Z = 85/3. 

9.x, = 55/7, x, = 30/7, x3 = 0; max. Z = 1553/7. 10. x, = 2, x. = 0; max. Z = 18. 
11. Degenerate solution: x, = 0 (non-basic); x, = 1, «3 = 0 (basic); max. Z = 3. 
12. x, =x, = 0,x, = 4; max. Z = 24. 


Exercises 12.6 

1. Min. W = 26y, + Ty»; subject to 6y, + 4y, = 10, 

By, + 2yg = 13, 3y, + Sy, = 19; yy, Yo, y3 2 O. 

2. Max. W = Ily, + Ty. + y3 + Sy4; subject to 3y, + 2y,—y3 + 3ys < 2, 

4y, + 3yy + 2y3 + yy <4, y, — 2ys + 3y3 + 2y4 <3; yy, Yo, Ys, Ys 2 O. 

3. Min. W = 6y, + 9y, + 1Oy3; subject to 4y, + 2y. + y3 23, — 5y, + 3y. + y3 2 1, 
9y, — 4y2 + 5y3 S— 4, y — 5y2 — Ty3 = 1, — 2y, + yo + LL y3 2 9; yi, Yo, Ys 2 O. 


4. Min. W = — 3y, + ys + 4y3; subject to y, + 3y, — 2y3 <— 3, 

Yi + Y3 = 16, y; — 2ys + y3 S— 7; Yi, Y2 = O, ys unrestricted in sign. 

5. Min. W = — 6y, + 3y2 + 4y5; subject to — y, + 3y2 — 4y3 23, 

—y, — 2yy + 8y32 1, —y, + 3y2 — 6y3 = 2; y, 2 O, Ys, ys unrestricted in sign. 


6. Max. W = 2y, + 3y,—5y3; subject to 2y, + 3y,—y3 S 2, 
3y, + Yo — 4y3 $3, Sy, + Ty — bys = 4; y;, Yo 2 O, ys unrestricted. 


Exercises 12.7 

1.x, =x, = 0,3 = 5/2; min. Z = 2.5. 2.4, = 4,x, = 2; max. Z = 10. 

3.4, = 7, x, = 0; max. Z = 21. 4, x, = 0, x, = 100, x3 = 230; max. Z = 1350. 
5. y, = 2/3, Ys = y3 = 0, min. W = - 4/3. 


Exercises 12.8 

1.x, =0,« = 1; max.Z=-1. 2.x, = 3/5, x5 = 6/5; min. Z = 12/5. 
3.x, = 6, x, = 2, x3 = 0; min. Z = 10. 

4, x, = 0, x, = 30/11, x; = 16/11, x, = 0; min. Z = 258/11. 

5. x, = 65/23, x, = 0, x; = 20/23, min. Z = 215/23. 


Exercises 12.9 
i ig X14 = 200, X19 = 50, Xoo = 175, Xo4 = 125, X33 = 275, X34 = 125; 
min. cost = US$ 12075. 
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2.413 = 14, x9) = 6, Xo9 = 5, X93 = 1, X39 = 5; min cost = US$143. 
3.1; = 50, X45 = 100, x5; = 150, x33 = 150, x4. = 100, x45 = 50; 

max. tonnage =US$ 3300. 
4, x1; = 20, x13 = 10, X95 = 20, X93 = 20, x24 = 10, x3 = 20; min. cost = US$180. 
5. x1; = 140, x, = 60, x5; = 40, x59 = 120, x33 = 90; min. cost = US$5920. 
6 
7 


6X4, = 5, Xy4 = 2, Xo9 = 2, X93 = 7, X99 = 6, X34 = 12; min. cost = US$743. 
» Xy, = 150, x13 = 20, Xo9 = 160, x54 = 40, x53 = 90, x3, = 90; max. profit = 
US$4920. 
8. X43 = 2, X99 = 1, X93 = 2, X53) = 4, X35 = 1; min. cost = US$33. 
9. x13 = 60, Xo; = 50, X93 = 20, x39 = 80; min. cost = US$750. 
10. x,5 = 800, x5, = 400, x3, = 100, x3. = 400, x33 = 200, x54 = 300, x45 = 300; 
min. cost = 9200. 


Exercises 12.10 

1. x1) = Xoo = X33 = 1; min. cost = US$18. 
2,.A>52,B53,C734, D1; min. Z = 38. 

3.1 B, II A, II > D, IV > C; min. cost = US$49. 
4 


. A > Dyn. Prog., B > Queuing Th., C > Reg. Analysis, D > L.P.; 
min. time = 28 hrs. 


A7>5,B>1,C7>4,D-3, E > 2; min. cost = US$9. 
A>X,B>W,C>V,D>Y, E> Z, min. time = 45 hrs. 

15 1V,23 0,3 VI,45 1,55 U1,6- V; min. profit = US$270. 
15 A,24B,35C, or 1 3 A, 24 C,3— B; min. cost = US$41. 


A>1,B>54,C56,D53,E>520rA53,B>4,C51,D>56,E->2; 
min. cost = US$52. 


era mM 


Exercises 12.11 
1. Section 12.5 Def. 2.2. it provides an optimality test. 3. Section 12.11 
4, Section 12.17 (1). 5. Section 12.14. 6. Section 12.6 (1). 
7. Min. W = Ty, + Sys, subject to 2y, + 3y < 4, 3y; — 2y2 <9, 2y, + 4y2 < 2, 
y, = 0, yz is unrestricted in sign. 
8. Section 12.12 (2). 9. Section 12.14. 
10. Minimize Z = (2x), + 3x1. + 11x; 4 ee + (5X5; + BXa9 + 8X93 + TXo4), 
subject to xy; + Xj + Xy3 + Xy4 = - (= 15), Xo; + Xoo + X03 + Xo4 = Bo (= 20), 
by 


yy + Xqy = Dy (= — 10), x49 + X99 = Dy (= 5); X13 + Xo3 = Dy (= 12), 
Xy4 + Xoq = Dy (= 8) and x; 2 0. [- La; = Xb, = 35 
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11 


12. 
13. 
16. 
18. 


19. 
22. 
24, 
25. 
26. 
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. (i) x, = 3, X. = 5, x3 = 0; (ii) x, = 0.5, x, = 0, x3 = 2.5. 

Section 12.5 (Def. 4) 

Section 12.13. 14, balanced. 15. Section 12.9. 

Section 12.7 (3). 17. optimal. 

Minimize y = 5y,— 3y3, subject to y, + y3 = 5, 2y, — 5y3 = 6, y; 20 

and y, unrestricted. 

5. 20. Max. Z = 5/19. 21. Section 12.7. 

Section 12.16. 23. Section 12.7 (2-4) 

Min. W = 2y, + 4y2 + 3y3, subject to —y, + Ys + y3 2 2, 2y, + yo 1, yi, yo 2 0. 
North-West corner rule and Vogel’s approximation method. 


Slack or surplus variables. 


Exercises 13.1 


1. 
2. 
5. 


(a) 21 (b) 0.84375 (c) 0.6640625 (d) 1.4140625. 
(a) 10110.101 (b) — 1010.001. 4, 1000101; 101111. 
(a) 0.009 (b) 0.106 x 10-4. 6. 0.001; 0.0000111. 


Exercises 14.1 


7 
10 


. 2.7065 8. 0.5177 
.x = 1.052, y = 1.369, z = 1.962. 13. 2591.87. 


Exercises 15.1 


7 
10 


. 2.7065 8. 0.5177 
<%= 1,052, -=-1.369, z = 1.962. 13. 2591.87. 


Exercises 16.1 


8 
11 


. 2.7065 9. 0.5177 
.x = 1.052, y = 1.369, z = 1.962. 13. 2591.87. 
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Absolute error, 4 
Acceleration of convergence, 51 
Accuracy of numbers, 2 
Adams-Bashforth method, 448 
program in C, 737 
program in C++, 821 program in 
MATLAB, 876 
Aitken’s A2-method, 51 
Algorithm, 652 
Approximating curve, 194 
Arthmetic operations, 650 
Assignment problem, 632 
working procedure for solving, 634 
Averaging operator, 252 


B 


Backward. differences, 235 
Backward interpolation formula, 
Newton's, 276 
using derivatives, 342 
Bairstow’s method, 78 
Bessel’s formula, 290 
Binary number, 647 
Bisection method, 38 
program in C, 674 
program in C++, 776 
program in MATLAB, 844 
Boole’s rule, 362 errors in, 375 
Boundary value problems, 421, 479 
finite-difference method, 480 


C 


Canonical form, 570-571 
Cayley-Hamilton theorem, 168 
Central differences, 236 
Central difference interpolation 


INDEX 


formulae, 286 


C language features, 658 


programs, 674 


C++ language features, 758 


programs, 776 


Complete pivoting, 119 


Complex roots, 77 
Computers, 645 


calculations, 652 
program writing, 655 
structure of, 646 


Consistency of equations, 108 
Constraints, 549 
Convergence of iterations, 50 
Convergence of method, 476 
Convex region, 555 

Cramer’s rule, 115 
Crank-Nicolson formula, 523 
Cubic splines, 326 

Curve fitting, 193 


graphical method, 194 

method of group averages, 219 
method of least squares, 200-201 
method of moments, 228 

of the type, 209-210 

of other curves, 212 


Cycling type of problems, 600 


D 


Degeneracy, 599 


in transportation problems, 627-628 


Determinants, 93 


basic properties, 95 
definition, 93 

expansion of, 94 

rule for multiplication, 96 


Derivatives, formula, 340 
Descarte’s rule of signs, 22 
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Difference equations, 397 inherent, 3 
formation of, 399 linear, 401 in quadrature formulae, 372 
order of, 398 in trapezoidal rule, 372 
reducible to linear form, 412 percentage, 4 
solution of, 399 relative, 4, 474 
simultaneous, 414 rounding off, 3 
Differences, rules for estimating, 3 
backward, 235 total, 473 
central, 236 truncation, 4, 473 
divided, 313 Equations, 
finite, 234 properties, 20 
forward, 234 transformation of, 26 
of a polynomial, 240 ill conditioned, 146 
Differential equations, Escalator method, 163 
second order, 468 Euler-Maclaurin formula, 380 
simultaneous first order, 463 Euler’s method, 429 
solution of, 420 Modified, 432 
Difference operators, 252 program in C, 729 
Divided differences, 313 program in C++, 815 
Divided difference formula, program in MATLAB, 871- 872 
Newton’s, 314 Everett’s formula, 291 
Double interpolation, 331 Extrapolation, 274 
Double root, 85 
Dual Simplex method, 613 F 


working procedure, 613 
Duality concept, 603 
Duality principle, 607 


Factorial notation, 242 
Factorization method, 126, 159 
program in C, 691 


E program in C++, 790 
program in MATLAB, 853 
Eigenvalue problem, 155 False position, method of, 43- 44 
Eigenvalues/Eigenvectors, 168 Finite differences, 234 
bounds for, 172 approximations to partial 
properties, 171 derivatives, 494 
Elliptic equations, 492 Finite-difference method, 480 
solution by relaxation method, 513 Floating point numbers, 645 
working procedure, 515 Flow chart, 652 
Emperical law, 193 Forward differences, 234 
Error analysis, 473 Forward differences interpolation 
Error propagation, 8 formula, Newton’s, 274 
Errors, 3 using derivatives, 340 
absolute, 4 
difference table, 248 G 


growth of, 15 
in approx. of a function, 11 
in a series approximation, 13 


Gauss’s backward interpolation 
formula, 288 


Gauss elimination method, 118, 156 

program in C, 687 

program in C++, 786 

program in MATLAB, 851 
Gauss Forward interpolation 

formula, 288 
Gauss formula, 385 
Gauss-Jordan method, 122, 157 

program in C, 689 

program in C++, 788 

program in MATLAB, 852 
Gauss-Legendre formula, 387 
Gauss-Seidal iteration 

method, 137, 498 

program in C, 695 

program in C++, 793 

program in MATLAB, 856 
Gaussian integration, 385, 387 
Generalised Newton’s method, 75 
Gerschgorin bounds, 173 
Gerschgorin circles, 173 
Given’s method, 183 
Graeffe’s root squaring method, 84 
Graphical solution of equations, 33 
Group averages, 219 

program in C, 706 

program in C++, 801-802 

program in MATLAB, 861 


H 


Heat equation, 

solution of 2 Dim, 530 

program in C, 745 

program in C++, 827 

program in MATLAB, 881 
Hermite’s interpolation formula, 320 
Horner’s method, 70-71 
Householder method, 186—187 
Hungarian method, 634 
Hyperbolic equations, 535 


I 


Ill-conditioned equations, 146 
Inherent errors, 3 


INDEX ¢ 933 


Initial approximation, 33 
Initial value problems, 421 
Iterative method, 334 
Interpolation, 274 

formula, 274, 292 

unequal intervals, 306 
Inverse interpolation, 332 
Inverse of a matrix, 104, 156 
Inverse operator of A, 247 
Iteration method, 50, 229 
Iterative methods, 131, 165, 334 

comparison of, 89 

in ill-conditioned system, 147 


J 


Jacobi’s method, 179, 498 
Jacobi’ iteration method, 132 


L 


Lagrange’s interpolation 

formula, 306 

program in C, 714 

program in C++, 807 

program in MATLAB, 866 
Lagrange’s method, 332 
Lagrangian polynomial, 306 
Laplace’s equation, 

solution of, 496 

diagonal 5-point formula, 496 

standard 5-point formula, 496 

program in C, 740 

program in C++, 823 

program in MATLAB, 877 
Laplace-Everett’s formula, 291 
Laws reducible to linear law, 195 
Least squares, 200-201 

program in C, 703 

program in C++, 799 

program in MATLAB, 860 

working procedure, 203 
Lin-Bairstow method, 78 
Linear difference equations, 401 
Linear programming problems, 548 

Graphical method, 555 
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Simplex method, 573 

Linear systems, solution of, 114 
Consistency, 108 

Lipschitz condition, 476 


M 


MATLAB, 
features, 838 
programs, 844 
M-method, 591 
of penalties, 591 
Matrices, 100 
equivalent, 106 
inverse of, 104 
operations on, 101 
rank of, 105 
related matrices, 104 
special matrices, 100 
Matrix inversion, 116, 156 
Maxima/Minima of tabulated 
function, 352 
Milne’s method, 448 
program in C, 734 
program in C++, 819 
program in MATLAB, 874 
Modified Euler’s method, 432 
Moments Method, 228 
program in C, 708 
program in C++, 803 
program in MATLAB, 863 
Muller’s method, 68 
program in C, 681 
program in C++, 781 
program in MATLAB, 849 
Multiple roots, 75 
by Newton’s method, 75 


N 


Newton’s backward interpolation 
formula, 276 

Newton’s divided difference formula, 
314 

program in C, 716 

program in C++, 808 

program in MATLAB, 644 


Newton-Cote’s formula, 867 
Newton’s forward interpolation 
formula, 274 
program in C, 711 
program in C++, 805 
program in MATLAB, 864 
Newton’s general interpolation formula, 
315 
Newton-Raphson method, 57, 149 
deductions from, 63 
program in C, 679 
program in C++, 780 
program in MATLAB, 848 
Numerical differentiation, 339 
Numerical double integration, 392 
Numerical integration, 358 
Boole’s rule, 362 
Euler-Maclaurin formula, 380 
Romberg, 375 
Simpson’s rules, 361, 392 
Trapezoidal rule, 360, 392 
Weddle’s rule, 363 
Numerical solution of ordinary 
differential equations, 419-490 
Adams-Bashforth method, 456 
Euler’s method, 429 
Modified Euler’s method, 432 
Milne’s method, 448 
Picard’s method, 421 
Runge’s method, 438 
Runge-Kutta method, 440 
Taylor series method, 424 
Numerical solution of partial 
differential equations, 491-545 
Heat equation, 522, 530 
Laplace equation, 496 
Poisson’s equation, 508 
Second order, 492 
Wave equation, 535 


O 


Objective function, 549 
Operators, 252 

relations between, 252 
Order of approximation, 14 


P 


Parabolic equations, 521 


Crank-Nicolson method, 523 
DuFort and Frankel method, 524 


Iterative method, 524 

Schmidt method, 522 
Partial Pivoting, 119 
Partition method, 162 
Percentage error, 4 
Perturbation procedure, 600 
Picard’s method, 421 
Polynomial interpolation, 274 
Polynomials equations, 70 

roots of, 70 

solution of, 70 


Poisson’s equation, solution of, 508 


Power method, 174 
program in C, 699 
program in C++, 796 
program in MATLAB, 858 


Predictor-Corrector methods, 449 


Propagation of error, 8 
Pseudo optimal solution, 592 


Q 


Quadratic convergence, 59, 76 


Quadrature formulae 
(Newton-Cotes), 359 
errors in, 372 


R 


Rank of a matrix, 105 
Rate of convergence, 38 
Reciprocal equation, 28 


Reciprocal factorial function, 246 


Redundant constraint, 560 
Regula falsi method, 43 
program in C, 676 
program in C++, 778 
program in MATLAB, 846 
Relative error, 4, 474 
Relaxation method, 142, 513 
Richardson scheme, 525 
Romberg method, 375 


Rounding-offerror, 2, 473 

Runge’s method, 438 

Runge-Kutta method, 440 
program in C, 732 
program in C++, 818 
program in MATLAB, 873 


S 


Scatter Diagram, 194 
Schmidt method, 522 
Secant method, 47 
Significant figures, 2 
Shift operator, 252 
Shooting method, 485 
Simplex method, 573, 578 
Simpson's rules, 361 
application of, 367 
errors in, 373, 374 
program in C, 726 
program in C++, 814 
program in MATLAB, 871 
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Simultaneous difference equations, 414 
Solution of differential equation, 420 


Solution of elliptic equations 

Solution Heat equation, 522 
program in C, 745 
program in C++, 827 
program in MATLAB, 881 


, 495 


Solution of one dimentional heat 


equation, 522 


Solution of Laplace equation, 496 


program in C, 740 

program in C++, 823 

program in MATLAB, 877 
Solution of L.P.P., 570 

basic, 573, 574 

degenerate, 573, 575 

feasible, 570, 574 

optimal, 570, 574 

two phase method, 596 


Solution of non-linear equations, 


149 


Solution of wave equation, 535 


program in C, 748 
program in C++, 829 
program in MATLAB, 882 


936 © NumericAL METHODS IN ENGINEERING AND SCIENCE 


Spline interpolations, 326 
Stability analysis, 476 
Standard forms of L.P.P, 571 
canonical form, 571 
Stirling’s Formula, 289 
Strum sequence, 185 
Summation of series, 265 
Symbolic relations, 252 
Synthetic division, 31 


T 


Taylor's series method, 424 

Three level method, 525 

Transcendental equation, 20 
solution of, 20 

Transpose of matrix, 104 

Transportation problems, 619 
balanced, 619 
degeneracy in, 627 
formulation of, 619 
working procedure for, 621 

Trapezoidal rule, 360, 392 
errors in, 372 


program in C, 724 

program in C++, 813 

program in MATLAB, 870 
Triangulisation method, 126 
Tridiagonal matrix, 183 
Truncation error, 4, 473 


U 


Undetermined coefficients, 
method of, 383 


Vv 


Values of unknown, 216 


Vogel’s approximation method, 621 


Ww 


Wave equation, solution of, 535 
Weddle’s rule, 363 


errors in, 375 


